2023-04-04 17:52:59,427 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-04-04 17:52:59,680 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876 2023-04-04 17:52:59,693 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-04-04 17:52:59,694 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f, deleteOnExit=true 2023-04-04 17:52:59,694 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-04-04 17:52:59,694 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/test.cache.data in system properties and HBase conf 2023-04-04 17:52:59,695 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/hadoop.tmp.dir in system properties and HBase conf 2023-04-04 17:52:59,695 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/hadoop.log.dir in system properties and HBase conf 2023-04-04 17:52:59,696 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/mapreduce.cluster.local.dir in system properties and HBase conf 2023-04-04 17:52:59,696 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-04-04 17:52:59,696 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-04-04 17:52:59,810 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-04-04 17:53:00,192 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-04-04 17:53:00,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-04-04 17:53:00,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-04-04 17:53:00,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-04-04 17:53:00,200 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-04-04 17:53:00,200 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-04-04 17:53:00,200 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-04-04 17:53:00,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-04-04 17:53:00,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/dfs.journalnode.edits.dir in system properties and HBase conf 2023-04-04 17:53:00,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-04-04 17:53:00,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/nfs.dump.dir in system properties and HBase conf 2023-04-04 17:53:00,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/java.io.tmpdir in system properties and HBase conf 2023-04-04 17:53:00,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/dfs.journalnode.edits.dir in system properties and HBase conf 2023-04-04 17:53:00,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-04-04 17:53:00,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-04-04 17:53:00,754 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-04-04 17:53:00,757 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-04-04 17:53:01,334 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-04-04 17:53:01,501 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-04-04 17:53:01,522 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-04-04 17:53:01,565 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-04-04 17:53:01,596 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/java.io.tmpdir/Jetty_localhost_localdomain_32997_hdfs____.ohtbke/webapp 2023-04-04 17:53:01,732 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:32997 2023-04-04 17:53:01,767 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-04-04 17:53:01,767 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-04-04 17:53:02,171 WARN [Listener at localhost.localdomain/46459] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-04-04 17:53:02,324 WARN [Listener at localhost.localdomain/46459] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-04-04 17:53:02,349 WARN [Listener at localhost.localdomain/46459] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-04-04 17:53:02,358 INFO [Listener at localhost.localdomain/46459] log.Slf4jLog(67): jetty-6.1.26 2023-04-04 17:53:02,366 INFO [Listener at localhost.localdomain/46459] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/java.io.tmpdir/Jetty_localhost_45783_datanode____.7105zc/webapp 2023-04-04 17:53:02,479 INFO [Listener at localhost.localdomain/46459] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45783 2023-04-04 17:53:02,928 WARN [Listener at localhost.localdomain/45763] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-04-04 17:53:03,361 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x873ead7938386c83: Processing first storage report for DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2 from datanode 1b878043-772f-439b-b310-3d01a44ebeb9 2023-04-04 17:53:03,362 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x873ead7938386c83: from storage DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2 node DatanodeRegistration(127.0.0.1:34461, datanodeUuid=1b878043-772f-439b-b310-3d01a44ebeb9, infoPort=35965, infoSecurePort=0, ipcPort=45763, storageInfo=lv=-57;cid=testClusterID;nsid=494302271;c=1680630780819), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-04-04 17:53:03,363 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x873ead7938386c83: Processing first storage report for DS-99fee0e1-c80f-481d-9265-33fa383547ac from datanode 1b878043-772f-439b-b310-3d01a44ebeb9 2023-04-04 17:53:03,363 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x873ead7938386c83: from storage DS-99fee0e1-c80f-481d-9265-33fa383547ac node DatanodeRegistration(127.0.0.1:34461, datanodeUuid=1b878043-772f-439b-b310-3d01a44ebeb9, infoPort=35965, infoSecurePort=0, ipcPort=45763, storageInfo=lv=-57;cid=testClusterID;nsid=494302271;c=1680630780819), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-04-04 17:53:03,433 DEBUG [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876 2023-04-04 17:53:03,486 INFO [Listener at localhost.localdomain/45763] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f/zookeeper_0, clientPort=61441, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-04-04 17:53:03,497 INFO [Listener at localhost.localdomain/45763] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61441 2023-04-04 17:53:03,508 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:03,510 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:04,144 INFO [Listener at localhost.localdomain/45763] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39 with version=8 2023-04-04 17:53:04,144 INFO [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/hbase-staging 2023-04-04 17:53:04,416 INFO [Listener at localhost.localdomain/45763] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-04-04 17:53:04,778 INFO [Listener at localhost.localdomain/45763] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=3 2023-04-04 17:53:04,804 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-04 17:53:04,804 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-04-04 17:53:04,804 INFO [Listener at localhost.localdomain/45763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-04-04 17:53:04,805 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-04 17:53:04,805 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-04-04 17:53:04,919 INFO [Listener at localhost.localdomain/45763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-04-04 17:53:04,992 DEBUG [Listener at localhost.localdomain/45763] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-04-04 17:53:05,087 INFO [Listener at localhost.localdomain/45763] ipc.NettyRpcServer(120): Bind to /136.243.18.41:38287 2023-04-04 17:53:05,096 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:05,098 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:05,116 INFO [Listener at localhost.localdomain/45763] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38287 connecting to ZooKeeper ensemble=127.0.0.1:61441 2023-04-04 17:53:05,148 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:382870x0, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-04-04 17:53:05,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38287-0x10155834d1a0000 connected 2023-04-04 17:53:05,173 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-04-04 17:53:05,174 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-04 17:53:05,177 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-04-04 17:53:05,184 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38287 2023-04-04 17:53:05,184 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38287 2023-04-04 17:53:05,185 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38287 2023-04-04 17:53:05,185 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38287 2023-04-04 17:53:05,185 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38287 2023-04-04 17:53:05,191 INFO [Listener at localhost.localdomain/45763] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39, hbase.cluster.distributed=false 2023-04-04 17:53:05,260 INFO [Listener at localhost.localdomain/45763] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=3 2023-04-04 17:53:05,260 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-04 17:53:05,260 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-04-04 17:53:05,261 INFO [Listener at localhost.localdomain/45763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-04-04 17:53:05,261 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-04 17:53:05,261 INFO [Listener at localhost.localdomain/45763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-04-04 17:53:05,265 INFO [Listener at localhost.localdomain/45763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-04-04 17:53:05,268 INFO [Listener at localhost.localdomain/45763] ipc.NettyRpcServer(120): Bind to /136.243.18.41:46251 2023-04-04 17:53:05,270 INFO [Listener at localhost.localdomain/45763] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-04 17:53:05,276 DEBUG [Listener at localhost.localdomain/45763] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-04-04 17:53:05,276 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:05,279 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:05,281 INFO [Listener at localhost.localdomain/45763] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46251 connecting to ZooKeeper ensemble=127.0.0.1:61441 2023-04-04 17:53:05,284 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:462510x0, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-04-04 17:53:05,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46251-0x10155834d1a0001 connected 2023-04-04 17:53:05,285 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-04-04 17:53:05,286 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-04 17:53:05,287 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-04-04 17:53:05,287 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46251 2023-04-04 17:53:05,288 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46251 2023-04-04 17:53:05,290 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46251 2023-04-04 17:53:05,290 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46251 2023-04-04 17:53:05,291 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46251 2023-04-04 17:53:05,293 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:05,301 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-04-04 17:53:05,302 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:05,317 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-04-04 17:53:05,318 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-04-04 17:53:05,318 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:05,319 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-04-04 17:53:05,320 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,38287,1680630784262 from backup master directory 2023-04-04 17:53:05,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-04-04 17:53:05,323 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:05,323 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-04-04 17:53:05,324 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-04-04 17:53:05,324 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:05,327 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-04-04 17:53:05,331 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-04-04 17:53:05,411 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/hbase.id with ID: 99202845-52d8-4b99-a4e5-191641423945 2023-04-04 17:53:05,454 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:05,472 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:05,508 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x65914e20 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:05,538 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50da0d08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:05,560 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-04-04 17:53:05,562 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-04-04 17:53:05,580 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-04-04 17:53:05,580 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-04-04 17:53:05,583 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-04-04 17:53:05,587 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-04-04 17:53:05,589 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-04-04 17:53:05,622 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store-tmp 2023-04-04 17:53:05,651 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:05,651 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-04-04 17:53:05,652 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:53:05,652 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:53:05,652 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-04-04 17:53:05,652 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:53:05,652 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:53:05,652 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-04-04 17:53:05,654 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/WALs/jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:05,676 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38287%2C1680630784262, suffix=, logDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/WALs/jenkins-hbase17.apache.org,38287,1680630784262, archiveDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/oldWALs, maxLogs=10 2023-04-04 17:53:05,731 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34461,DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2,DISK] 2023-04-04 17:53:05,741 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-04-04 17:53:05,814 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/WALs/jenkins-hbase17.apache.org,38287,1680630784262/jenkins-hbase17.apache.org%2C38287%2C1680630784262.1680630785685 2023-04-04 17:53:05,815 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34461,DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2,DISK]] 2023-04-04 17:53:05,815 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:05,816 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:05,819 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-04-04 17:53:05,820 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-04-04 17:53:05,880 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-04-04 17:53:05,887 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-04-04 17:53:05,909 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-04-04 17:53:05,925 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:05,931 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-04-04 17:53:05,933 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-04-04 17:53:05,951 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-04-04 17:53:05,955 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:05,957 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72219561, jitterRate=0.07615531980991364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:53:05,957 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-04-04 17:53:05,958 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-04-04 17:53:05,977 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-04-04 17:53:05,978 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-04-04 17:53:05,981 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-04-04 17:53:05,983 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-04-04 17:53:06,012 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 29 msec 2023-04-04 17:53:06,013 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-04-04 17:53:06,044 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-04-04 17:53:06,049 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-04-04 17:53:06,071 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-04-04 17:53:06,075 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-04-04 17:53:06,077 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-04-04 17:53:06,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-04-04 17:53:06,088 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-04-04 17:53:06,092 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:06,094 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-04-04 17:53:06,094 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-04-04 17:53:06,109 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-04-04 17:53:06,113 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-04-04 17:53:06,113 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-04-04 17:53:06,113 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:06,114 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,38287,1680630784262, sessionid=0x10155834d1a0000, setting cluster-up flag (Was=false) 2023-04-04 17:53:06,128 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:06,133 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-04-04 17:53:06,135 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:06,149 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:06,156 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-04-04 17:53:06,157 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:06,160 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp 2023-04-04 17:53:06,195 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(952): ClusterId : 99202845-52d8-4b99-a4e5-191641423945 2023-04-04 17:53:06,199 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-04-04 17:53:06,205 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-04-04 17:53:06,205 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-04-04 17:53:06,208 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-04-04 17:53:06,209 DEBUG [RS:0;jenkins-hbase17:46251] zookeeper.ReadOnlyZKClient(139): Connect 0x7801a339 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:06,217 DEBUG [RS:0;jenkins-hbase17:46251] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76c64249, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:06,218 DEBUG [RS:0;jenkins-hbase17:46251] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f9c849, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-04-04 17:53:06,241 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:46251 2023-04-04 17:53:06,245 INFO [RS:0;jenkins-hbase17:46251] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-04-04 17:53:06,245 INFO [RS:0;jenkins-hbase17:46251] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-04-04 17:53:06,245 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1023): About to register with Master. 2023-04-04 17:53:06,248 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase17.apache.org,38287,1680630784262 with isa=jenkins-hbase17.apache.org/136.243.18.41:46251, startcode=1680630785259 2023-04-04 17:53:06,270 DEBUG [RS:0;jenkins-hbase17:46251] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-04-04 17:53:06,304 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-04-04 17:53:06,314 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-04-04 17:53:06,314 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-04-04 17:53:06,314 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-04-04 17:53:06,314 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-04-04 17:53:06,315 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-04-04 17:53:06,315 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,315 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-04-04 17:53:06,316 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,331 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1680630816331 2023-04-04 17:53:06,333 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-04-04 17:53:06,342 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48667, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-04-04 17:53:06,345 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-04-04 17:53:06,348 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-04-04 17:53:06,349 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-04-04 17:53:06,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-04-04 17:53:06,357 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-04-04 17:53:06,357 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-04-04 17:53:06,358 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-04-04 17:53:06,358 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-04-04 17:53:06,358 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-04-04 17:53:06,359 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,362 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-04-04 17:53:06,365 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-04-04 17:53:06,366 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-04-04 17:53:06,370 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-04-04 17:53:06,371 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-04-04 17:53:06,373 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1680630786373,5,FailOnTimeoutGroup] 2023-04-04 17:53:06,373 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1680630786373,5,FailOnTimeoutGroup] 2023-04-04 17:53:06,373 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,374 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-04-04 17:53:06,375 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,375 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,384 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(2829): Master is not running yet 2023-04-04 17:53:06,385 WARN [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 100 ms and then retrying. 2023-04-04 17:53:06,486 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase17.apache.org,38287,1680630784262 with isa=jenkins-hbase17.apache.org/136.243.18.41:46251, startcode=1680630785259 2023-04-04 17:53:06,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:06,496 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39 2023-04-04 17:53:06,497 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46459 2023-04-04 17:53:06,497 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-04-04 17:53:06,501 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-04-04 17:53:06,502 DEBUG [RS:0;jenkins-hbase17:46251] zookeeper.ZKUtil(162): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:06,502 WARN [RS:0;jenkins-hbase17:46251] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-04-04 17:53:06,503 INFO [RS:0;jenkins-hbase17:46251] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-04-04 17:53:06,503 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/WALs/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:06,504 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,46251,1680630785259] 2023-04-04 17:53:06,513 DEBUG [RS:0;jenkins-hbase17:46251] zookeeper.ZKUtil(162): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:06,523 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-04-04 17:53:06,534 INFO [RS:0;jenkins-hbase17:46251] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-04-04 17:53:06,563 INFO [RS:0;jenkins-hbase17:46251] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-04-04 17:53:06,566 INFO [RS:0;jenkins-hbase17:46251] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:53:06,566 INFO [RS:0;jenkins-hbase17:46251] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,567 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-04-04 17:53:06,574 INFO [RS:0;jenkins-hbase17:46251] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,574 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,574 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,575 DEBUG [RS:0;jenkins-hbase17:46251] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-04-04 17:53:06,576 INFO [RS:0;jenkins-hbase17:46251] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,576 INFO [RS:0;jenkins-hbase17:46251] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,577 INFO [RS:0;jenkins-hbase17:46251] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,593 INFO [RS:0;jenkins-hbase17:46251] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-04-04 17:53:06,596 INFO [RS:0;jenkins-hbase17:46251] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46251,1680630785259-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:06,611 INFO [RS:0;jenkins-hbase17:46251] regionserver.Replication(203): jenkins-hbase17.apache.org,46251,1680630785259 started 2023-04-04 17:53:06,612 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1638): Serving as jenkins-hbase17.apache.org,46251,1680630785259, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:46251, sessionid=0x10155834d1a0001 2023-04-04 17:53:06,612 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-04-04 17:53:06,612 DEBUG [RS:0;jenkins-hbase17:46251] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:06,612 DEBUG [RS:0;jenkins-hbase17:46251] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,46251,1680630785259' 2023-04-04 17:53:06,612 DEBUG [RS:0;jenkins-hbase17:46251] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:06,613 DEBUG [RS:0;jenkins-hbase17:46251] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:06,614 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-04-04 17:53:06,614 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-04-04 17:53:06,614 DEBUG [RS:0;jenkins-hbase17:46251] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:06,614 DEBUG [RS:0;jenkins-hbase17:46251] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,46251,1680630785259' 2023-04-04 17:53:06,614 DEBUG [RS:0;jenkins-hbase17:46251] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-04-04 17:53:06,614 DEBUG [RS:0;jenkins-hbase17:46251] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-04-04 17:53:06,615 DEBUG [RS:0;jenkins-hbase17:46251] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-04-04 17:53:06,615 INFO [RS:0;jenkins-hbase17:46251] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-04-04 17:53:06,615 INFO [RS:0;jenkins-hbase17:46251] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-04-04 17:53:06,728 INFO [RS:0;jenkins-hbase17:46251] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C46251%2C1680630785259, suffix=, logDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/WALs/jenkins-hbase17.apache.org,46251,1680630785259, archiveDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/oldWALs, maxLogs=32 2023-04-04 17:53:06,747 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34461,DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2,DISK] 2023-04-04 17:53:06,753 INFO [RS:0;jenkins-hbase17:46251] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/WALs/jenkins-hbase17.apache.org,46251,1680630785259/jenkins-hbase17.apache.org%2C46251%2C1680630785259.1680630786730 2023-04-04 17:53:06,754 DEBUG [RS:0;jenkins-hbase17:46251] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34461,DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2,DISK]] 2023-04-04 17:53:06,794 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:06,796 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:06,796 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39 2023-04-04 17:53:07,219 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:07,221 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-04-04 17:53:07,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/info 2023-04-04 17:53:07,226 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-04-04 17:53:07,227 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:07,227 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-04-04 17:53:07,230 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/rep_barrier 2023-04-04 17:53:07,231 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-04-04 17:53:07,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:07,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-04-04 17:53:07,234 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/table 2023-04-04 17:53:07,235 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-04-04 17:53:07,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:07,237 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740 2023-04-04 17:53:07,238 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740 2023-04-04 17:53:07,243 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-04-04 17:53:07,245 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-04-04 17:53:07,248 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:07,250 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62945103, jitterRate=-0.06204487383365631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-04-04 17:53:07,250 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-04-04 17:53:07,250 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-04-04 17:53:07,250 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-04-04 17:53:07,250 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-04-04 17:53:07,250 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-04-04 17:53:07,251 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-04-04 17:53:07,251 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-04-04 17:53:07,252 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-04-04 17:53:07,257 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-04-04 17:53:07,257 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-04-04 17:53:07,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-04-04 17:53:07,279 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-04-04 17:53:07,281 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-04-04 17:53:07,434 DEBUG [jenkins-hbase17:38287] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-04-04 17:53:07,437 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,46251,1680630785259, state=OPENING 2023-04-04 17:53:07,443 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-04-04 17:53:07,444 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:07,445 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-04-04 17:53:07,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:07,633 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:07,636 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-04-04 17:53:07,639 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-04-04 17:53:07,652 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-04-04 17:53:07,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-04-04 17:53:07,657 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C46251%2C1680630785259.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/WALs/jenkins-hbase17.apache.org,46251,1680630785259, archiveDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/oldWALs, maxLogs=32 2023-04-04 17:53:07,671 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34461,DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2,DISK] 2023-04-04 17:53:07,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/WALs/jenkins-hbase17.apache.org,46251,1680630785259/jenkins-hbase17.apache.org%2C46251%2C1680630785259.meta.1680630787658.meta 2023-04-04 17:53:07,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34461,DS-f8ebf87a-9617-4fda-900a-4b266fd51fd2,DISK]] 2023-04-04 17:53:07,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:07,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-04-04 17:53:07,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-04-04 17:53:07,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-04-04 17:53:07,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-04-04 17:53:07,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:07,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-04-04 17:53:07,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-04-04 17:53:07,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-04-04 17:53:07,715 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/info 2023-04-04 17:53:07,715 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/info 2023-04-04 17:53:07,716 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-04-04 17:53:07,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:07,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-04-04 17:53:07,719 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/rep_barrier 2023-04-04 17:53:07,719 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/rep_barrier 2023-04-04 17:53:07,719 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-04-04 17:53:07,720 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:07,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-04-04 17:53:07,723 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/table 2023-04-04 17:53:07,723 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/table 2023-04-04 17:53:07,724 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-04-04 17:53:07,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:07,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740 2023-04-04 17:53:07,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740 2023-04-04 17:53:07,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-04-04 17:53:07,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-04-04 17:53:07,738 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64758186, jitterRate=-0.03502783179283142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-04-04 17:53:07,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-04-04 17:53:07,747 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1680630787626 2023-04-04 17:53:07,762 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-04-04 17:53:07,762 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-04-04 17:53:07,763 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,46251,1680630785259, state=OPEN 2023-04-04 17:53:07,765 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-04-04 17:53:07,765 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-04-04 17:53:07,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-04-04 17:53:07,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,46251,1680630785259 in 318 msec 2023-04-04 17:53:07,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-04-04 17:53:07,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 505 msec 2023-04-04 17:53:07,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5550 sec 2023-04-04 17:53:07,782 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1680630787781, completionTime=-1 2023-04-04 17:53:07,782 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-04-04 17:53:07,782 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-04-04 17:53:07,839 DEBUG [hconnection-0xa0b52c2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:07,842 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:07,859 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-04-04 17:53:07,859 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1680630847859 2023-04-04 17:53:07,859 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1680630907859 2023-04-04 17:53:07,859 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 76 msec 2023-04-04 17:53:07,885 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38287,1680630784262-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:07,885 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38287,1680630784262-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:07,885 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38287,1680630784262-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:07,887 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:38287, period=300000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:07,887 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-04-04 17:53:07,893 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-04-04 17:53:07,900 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-04-04 17:53:07,901 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-04-04 17:53:07,910 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-04-04 17:53:07,912 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:53:07,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:53:07,936 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:07,939 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be empty. 2023-04-04 17:53:07,940 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:07,940 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-04-04 17:53:08,363 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:08,367 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f068ce02f875f9e2eb9ce3fa1b0638be, NAME => 'hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:08,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:08,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f068ce02f875f9e2eb9ce3fa1b0638be, disabling compactions & flushes 2023-04-04 17:53:08,783 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:53:08,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:53:08,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. after waiting 0 ms 2023-04-04 17:53:08,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:53:08,783 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:53:08,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f068ce02f875f9e2eb9ce3fa1b0638be: 2023-04-04 17:53:08,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:53:08,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680630788792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630788792"}]},"ts":"1680630788792"} 2023-04-04 17:53:08,836 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:53:08,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:53:08,843 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630788838"}]},"ts":"1680630788838"} 2023-04-04 17:53:08,849 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-04-04 17:53:08,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f068ce02f875f9e2eb9ce3fa1b0638be, ASSIGN}] 2023-04-04 17:53:08,858 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f068ce02f875f9e2eb9ce3fa1b0638be, ASSIGN 2023-04-04 17:53:08,860 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f068ce02f875f9e2eb9ce3fa1b0638be, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:09,011 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f068ce02f875f9e2eb9ce3fa1b0638be, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:09,012 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680630789011"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630789011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630789011"}]},"ts":"1680630789011"} 2023-04-04 17:53:09,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f068ce02f875f9e2eb9ce3fa1b0638be, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:09,179 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:53:09,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f068ce02f875f9e2eb9ce3fa1b0638be, NAME => 'hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:09,181 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:09,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:09,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:09,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:09,185 INFO [StoreOpener-f068ce02f875f9e2eb9ce3fa1b0638be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:09,187 DEBUG [StoreOpener-f068ce02f875f9e2eb9ce3fa1b0638be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/info 2023-04-04 17:53:09,187 DEBUG [StoreOpener-f068ce02f875f9e2eb9ce3fa1b0638be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/info 2023-04-04 17:53:09,188 INFO [StoreOpener-f068ce02f875f9e2eb9ce3fa1b0638be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f068ce02f875f9e2eb9ce3fa1b0638be columnFamilyName info 2023-04-04 17:53:09,189 INFO [StoreOpener-f068ce02f875f9e2eb9ce3fa1b0638be-1] regionserver.HStore(310): Store=f068ce02f875f9e2eb9ce3fa1b0638be/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:09,191 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:09,192 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:09,198 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:53:09,203 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:09,204 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened f068ce02f875f9e2eb9ce3fa1b0638be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62502325, jitterRate=-0.06864278018474579}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:53:09,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for f068ce02f875f9e2eb9ce3fa1b0638be: 2023-04-04 17:53:09,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be., pid=6, masterSystemTime=1680630789170 2023-04-04 17:53:09,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:53:09,211 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:53:09,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f068ce02f875f9e2eb9ce3fa1b0638be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:09,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680630789212"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630789212"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630789212"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630789212"}]},"ts":"1680630789212"} 2023-04-04 17:53:09,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-04-04 17:53:09,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f068ce02f875f9e2eb9ce3fa1b0638be, server=jenkins-hbase17.apache.org,46251,1680630785259 in 202 msec 2023-04-04 17:53:09,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-04-04 17:53:09,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f068ce02f875f9e2eb9ce3fa1b0638be, ASSIGN in 367 msec 2023-04-04 17:53:09,227 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:53:09,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630789227"}]},"ts":"1680630789227"} 2023-04-04 17:53:09,230 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-04-04 17:53:09,234 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:53:09,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3320 sec 2023-04-04 17:53:09,314 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-04-04 17:53:09,316 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-04-04 17:53:09,316 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:53:09,352 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-04-04 17:53:09,367 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-04-04 17:53:09,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 27 msec 2023-04-04 17:53:09,386 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-04-04 17:53:09,397 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-04-04 17:53:09,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-04-04 17:53:09,411 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-04-04 17:53:09,413 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-04-04 17:53:09,413 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.089sec 2023-04-04 17:53:09,415 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-04-04 17:53:09,417 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-04-04 17:53:09,417 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-04-04 17:53:09,418 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38287,1680630784262-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-04-04 17:53:09,419 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38287,1680630784262-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-04-04 17:53:09,431 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-04-04 17:53:09,505 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(139): Connect 0x3a61cdd0 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:09,510 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bba15f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:09,521 DEBUG [hconnection-0x78a4344e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:09,532 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:09,540 INFO [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:53:09,541 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(139): Connect 0x716f2b59 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:09,545 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45f95a85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:09,545 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:53:09,566 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=388, ProcessCount=173, AvailableMemoryMB=7934 2023-04-04 17:53:09,579 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:53:09,583 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:53:09,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-04 17:53:09,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:09,603 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:53:09,606 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:53:09,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-04-04 17:53:09,609 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:09,611 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5 empty. 2023-04-04 17:53:09,613 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:09,614 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-04-04 17:53:09,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-04 17:53:09,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-04 17:53:09,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-04 17:53:10,040 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:10,042 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1d720ad2c4dc903c0b50df1d59f3ccf5, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:10,057 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:10,057 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 1d720ad2c4dc903c0b50df1d59f3ccf5, disabling compactions & flushes 2023-04-04 17:53:10,057 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,057 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,057 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. after waiting 0 ms 2023-04-04 17:53:10,057 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,057 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,057 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:10,062 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:53:10,064 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680630790064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630790064"}]},"ts":"1680630790064"} 2023-04-04 17:53:10,066 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:53:10,068 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:53:10,068 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630790068"}]},"ts":"1680630790068"} 2023-04-04 17:53:10,070 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-04-04 17:53:10,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, ASSIGN}] 2023-04-04 17:53:10,075 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, ASSIGN 2023-04-04 17:53:10,077 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:10,228 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1d720ad2c4dc903c0b50df1d59f3ccf5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:10,229 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680630790228"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630790228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630790228"}]},"ts":"1680630790228"} 2023-04-04 17:53:10,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1d720ad2c4dc903c0b50df1d59f3ccf5, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:10,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-04 17:53:10,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1d720ad2c4dc903c0b50df1d59f3ccf5, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:10,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:10,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:10,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:10,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:10,403 INFO [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:10,405 DEBUG [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:10,405 DEBUG [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:10,408 INFO [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d720ad2c4dc903c0b50df1d59f3ccf5 columnFamilyName family1 2023-04-04 17:53:10,412 INFO [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] regionserver.HStore(310): Store=1d720ad2c4dc903c0b50df1d59f3ccf5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:10,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:10,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:10,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:10,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:10,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1d720ad2c4dc903c0b50df1d59f3ccf5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73535391, jitterRate=0.0957627147436142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:53:10,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:10,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5., pid=11, masterSystemTime=1680630790390 2023-04-04 17:53:10,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1d720ad2c4dc903c0b50df1d59f3ccf5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:10,436 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680630790436"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630790436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630790436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630790436"}]},"ts":"1680630790436"} 2023-04-04 17:53:10,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-04-04 17:53:10,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1d720ad2c4dc903c0b50df1d59f3ccf5, server=jenkins-hbase17.apache.org,46251,1680630785259 in 206 msec 2023-04-04 17:53:10,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-04-04 17:53:10,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, ASSIGN in 371 msec 2023-04-04 17:53:10,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:53:10,450 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630790450"}]},"ts":"1680630790450"} 2023-04-04 17:53:10,452 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-04-04 17:53:10,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:53:10,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 856 msec 2023-04-04 17:53:10,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-04 17:53:10,740 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-04-04 17:53:10,758 DEBUG [hconnection-0x49bd3eff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:10,762 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:10,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:10,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,927 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:10,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:10,928 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:10,928 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:10,928 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,929 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:10,930 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:10,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:10,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:10,930 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:10,930 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:10,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:10,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:10,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:10,934 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:10,935 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:10,935 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:10,935 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:10,936 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:10,937 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-04 17:53:11,481 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ac552f76d10542f18a31f302e66d0ff1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130ac552f76d10542f18a31f302e66d0ff1 2023-04-04 17:53:11,899 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/6be1b8361e0344cebd7a0dbe47f0c993 2023-04-04 17:53:11,916 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/6be1b8361e0344cebd7a0dbe47f0c993 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/6be1b8361e0344cebd7a0dbe47f0c993 2023-04-04 17:53:11,925 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/6be1b8361e0344cebd7a0dbe47f0c993, entries=1000, sequenceid=5, filesize=175.8 K 2023-04-04 17:53:11,928 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 991ms, sequenceid=5, compaction requested=false 2023-04-04 17:53:11,930 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:11,933 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:11,933 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:11,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:11,934 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:11,934 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,934 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:11,934 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:11,936 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,936 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:11,936 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,936 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:11,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:11,938 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:11,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64d85fa2[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:11,938 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,940 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:11,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:11,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:11,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:11,942 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,942 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:11,942 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:11,942 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:11,946 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:11,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:11,946 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:11,946 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:11,946 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,946 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:11,948 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,948 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,949 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:11,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:11,949 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,951 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,959 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,959 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:11,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:11,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:11,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:11,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:11,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:11,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:11,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:11,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:11,962 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:11,962 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:12,063 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:12,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:12,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:12,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:12,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,084 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:12,084 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:12,084 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:12,084 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:12,085 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,085 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,086 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:12,086 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:12,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:12,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:12,087 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:12,087 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,088 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,088 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:12,089 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:12,089 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:12,089 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:12,089 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:12,089 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:12,089 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:12,089 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:12,090 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-04 17:53:12,529 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-04-04 17:53:12,531 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-04-04 17:53:12,531 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d7249bcf59b546609baf88b029b7c17a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d7249bcf59b546609baf88b029b7c17a 2023-04-04 17:53:12,970 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/a079d9cb4b514936a950d9112decfee1 2023-04-04 17:53:12,988 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/a079d9cb4b514936a950d9112decfee1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/a079d9cb4b514936a950d9112decfee1 2023-04-04 17:53:13,000 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/a079d9cb4b514936a950d9112decfee1, entries=1, sequenceid=9, filesize=5.0 K 2023-04-04 17:53:13,002 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 912ms, sequenceid=9, compaction requested=false 2023-04-04 17:53:13,002 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:13,003 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:13,003 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:13,003 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:13,003 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,003 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:13,003 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:13,005 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,005 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:13,006 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,006 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:13,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:13,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:13,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df4a78[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:13,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:13,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,009 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:13,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:13,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:13,009 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,009 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:13,012 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,012 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:13,013 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:13,013 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:13,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:13,016 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:13,016 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:13,016 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:13,016 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,016 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:13,017 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,017 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,017 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:13,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:13,018 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:13,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,019 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,022 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,022 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:13,023 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:13,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:13,023 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,023 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:13,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:13,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:13,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-04 17:53:13,023 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:13,023 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,024 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:13,024 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,024 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:13,024 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,024 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:13,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:13,124 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:13,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:13,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:13,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:13,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,141 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:13,141 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:13,141 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:13,141 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:13,142 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,142 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,143 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:13,143 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:13,143 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,143 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:13,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,144 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:13,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:13,144 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:13,145 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:13,145 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:13,145 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:13,145 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:13,145 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:13,145 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:13,145 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:13,236 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:53:13,582 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011d1ea500e9c54dcdadbf868221510fb2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512011d1ea500e9c54dcdadbf868221510fb2 2023-04-04 17:53:13,998 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/7687c23c958942dd9828413d40bac54f 2023-04-04 17:53:14,011 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/7687c23c958942dd9828413d40bac54f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7687c23c958942dd9828413d40bac54f 2023-04-04 17:53:14,020 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7687c23c958942dd9828413d40bac54f, entries=1, sequenceid=13, filesize=5.0 K 2023-04-04 17:53:14,021 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 876ms, sequenceid=13, compaction requested=true 2023-04-04 17:53:14,022 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:14,022 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:14,022 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:14,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:14,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:14,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:14,025 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,025 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:14,025 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,025 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:14,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:14,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:14,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:14,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:14,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52d2cc03[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:14,027 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:14,027 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,028 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,028 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:14,028 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:14,029 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:14,029 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,029 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:14,030 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,030 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,030 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:14,030 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:14,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:14,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:14,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:14,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:14,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:14,033 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:14,033 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:14,033 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:14,033 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,034 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:14,035 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,035 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,035 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:14,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:14,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:14,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:14,036 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:14,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,038 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,042 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,042 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:14,042 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:14,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:14,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:14,042 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:14,042 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:14,042 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,042 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,043 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,043 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,043 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:14,043 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:14,043 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:14,143 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:14,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:14,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:14,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:14,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,164 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:14,164 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:14,165 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:14,165 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:14,165 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,166 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,167 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,167 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:14,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:14,167 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,167 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:14,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,168 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,168 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:14,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,168 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:14,169 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:14,169 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:14,169 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:14,169 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:14,169 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:14,169 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:14,169 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:14,194 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055a93d576ec2d492ba0ef11c4bab251c2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055a93d576ec2d492ba0ef11c4bab251c2 2023-04-04 17:53:14,411 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-04-04 17:53:14,412 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-04-04 17:53:14,609 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/ef0674dbdc5c4c73b3fd91f904d6190a 2023-04-04 17:53:14,627 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/ef0674dbdc5c4c73b3fd91f904d6190a as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ef0674dbdc5c4c73b3fd91f904d6190a 2023-04-04 17:53:14,637 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ef0674dbdc5c4c73b3fd91f904d6190a, entries=1, sequenceid=17, filesize=5.0 K 2023-04-04 17:53:14,639 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 470ms, sequenceid=17, compaction requested=true 2023-04-04 17:53:14,639 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:14,639 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:14,639 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:14,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:14,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:14,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:14,642 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,642 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:14,642 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,642 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:14,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:14,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59ea1e7[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:14,644 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:14,644 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,645 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,645 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:14,645 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:14,645 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:14,645 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,645 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:14,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:14,647 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:14,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:14,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:14,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:14,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:14,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:14,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:14,651 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:14,651 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:14,651 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:14,651 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,651 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:14,653 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,653 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:14,653 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:14,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:14,654 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,655 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:14,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,659 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,659 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:14,659 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:14,659 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:14,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:14,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:14,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:14,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:14,659 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,660 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,660 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,660 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:14,660 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:14,660 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:14,661 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:14,761 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:14,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:14,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:14,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:14,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,777 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:14,777 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:14,777 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:14,777 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:14,778 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,778 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,779 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,779 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:14,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:14,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:14,780 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:14,780 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:14,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:14,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,781 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,781 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:14,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:14,781 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:14,781 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:14,782 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:14,782 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:14,782 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:14,782 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:14,782 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:14,782 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:15,210 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e6b8f26bf2d04a6987db67dcbe9e4164 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e6b8f26bf2d04a6987db67dcbe9e4164 2023-04-04 17:53:15,626 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/2fa4879c52504819b599df3d77242329 2023-04-04 17:53:15,638 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/2fa4879c52504819b599df3d77242329 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/2fa4879c52504819b599df3d77242329 2023-04-04 17:53:15,645 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/2fa4879c52504819b599df3d77242329, entries=1, sequenceid=21, filesize=5.0 K 2023-04-04 17:53:15,646 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 864ms, sequenceid=21, compaction requested=true 2023-04-04 17:53:15,646 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:15,646 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:15,646 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:15,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:15,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:15,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:15,649 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,649 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:15,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:15,649 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,649 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:15,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:15,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:15,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:15,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:15,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@239dcbb9[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:15,652 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:15,652 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,652 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,652 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:15,653 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:15,653 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,653 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:15,653 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:15,654 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,654 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:15,654 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:15,654 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:15,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:15,657 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:15,657 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:15,657 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:15,657 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,657 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:15,658 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,658 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:15,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,658 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:15,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:15,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,661 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:15,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:15,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:15,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:15,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:15,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:15,664 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:15,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:15,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,665 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,665 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,665 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:15,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:15,665 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:15,766 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:15,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:15,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:15,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:15,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,784 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:15,784 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:15,784 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:15,785 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:15,785 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,785 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,786 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,786 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:15,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:15,786 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:15,786 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,788 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:15,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:15,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:15,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:15,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:15,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:15,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:15,788 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:15,788 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:15,788 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:15,811 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e72fcccc819c4a45aa2ee426fe9f4904 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e72fcccc819c4a45aa2ee426fe9f4904 2023-04-04 17:53:16,221 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/1d85facfdb6a485b86404d5daa55e12c 2023-04-04 17:53:16,234 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/1d85facfdb6a485b86404d5daa55e12c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/1d85facfdb6a485b86404d5daa55e12c 2023-04-04 17:53:16,241 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/1d85facfdb6a485b86404d5daa55e12c, entries=1, sequenceid=25, filesize=5.0 K 2023-04-04 17:53:16,242 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 454ms, sequenceid=25, compaction requested=true 2023-04-04 17:53:16,243 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:16,243 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:16,243 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:16,243 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:16,243 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,243 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:16,243 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:16,245 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,245 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:16,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:16,245 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,245 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:16,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:16,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:16,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:16,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:16,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f6dc938[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:16,248 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:16,248 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,249 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,249 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:16,249 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:16,249 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:16,249 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,249 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:16,251 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,251 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:16,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:16,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:16,251 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:16,251 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:16,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:16,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:16,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:16,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:16,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:16,254 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:16,254 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:16,254 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:16,254 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,255 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:16,256 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,256 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,256 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:16,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:16,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:16,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:16,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:16,256 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,258 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:16,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:16,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:16,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:16,260 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:16,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:16,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:16,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:16,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-04 17:53:16,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:16,261 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:16,261 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,261 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,261 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:16,261 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:16,361 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:16,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:16,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:16,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:16,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,376 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:16,376 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:16,377 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:16,377 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:16,378 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,378 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,379 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:16,379 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:16,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:16,379 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:16,379 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:16,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:16,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,381 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:16,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:16,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:16,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:16,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:16,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:16,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:16,383 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:16,383 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:16,383 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:16,815 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f9d6542757524c20b665ad8248dfbb1c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9d6542757524c20b665ad8248dfbb1c 2023-04-04 17:53:17,226 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/fd0dae5034fd427eaa940392c4d9b0f6 2023-04-04 17:53:17,242 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/fd0dae5034fd427eaa940392c4d9b0f6 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fd0dae5034fd427eaa940392c4d9b0f6 2023-04-04 17:53:17,251 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fd0dae5034fd427eaa940392c4d9b0f6, entries=1, sequenceid=29, filesize=5.0 K 2023-04-04 17:53:17,252 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 869ms, sequenceid=29, compaction requested=true 2023-04-04 17:53:17,253 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:17,253 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:17,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:17,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:17,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:17,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:17,255 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,255 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:17,255 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,255 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b9ba402[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:17,257 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:17,258 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,258 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,259 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:17,259 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:17,259 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:17,259 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,259 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:17,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:17,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:17,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:17,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:17,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:17,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:17,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:17,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:17,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:17,264 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:17,264 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:17,264 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:17,264 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,264 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:17,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:17,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:17,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:17,266 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,267 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,271 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,271 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:17,271 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:17,271 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:17,271 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,271 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:17,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:17,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:17,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:17,272 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,272 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,272 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,272 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,272 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:17,272 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:17,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:17,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:17,373 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:17,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:17,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:17,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:17,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,388 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:17,388 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:17,389 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:17,389 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:17,390 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,390 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,391 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:17,391 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:17,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:17,392 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:17,392 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:17,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,393 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,394 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:17,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:17,394 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:17,394 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:17,394 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:17,395 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:17,395 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:17,395 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:17,395 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:17,395 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:17,826 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010356b434d7dc6f4e379db5b442d8a9b05a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010356b434d7dc6f4e379db5b442d8a9b05a 2023-04-04 17:53:18,236 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/e1a74950bc204874b60e9fcbdf14f46d 2023-04-04 17:53:18,252 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/e1a74950bc204874b60e9fcbdf14f46d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/e1a74950bc204874b60e9fcbdf14f46d 2023-04-04 17:53:18,262 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/e1a74950bc204874b60e9fcbdf14f46d, entries=1, sequenceid=33, filesize=5.0 K 2023-04-04 17:53:18,263 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 868ms, sequenceid=33, compaction requested=true 2023-04-04 17:53:18,263 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:18,263 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:18,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:18,264 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:18,264 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,264 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:18,264 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:18,265 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:18,266 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,266 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:18,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:18,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bfaaf0f[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:18,267 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:18,267 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,268 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,268 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:18,268 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,268 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:18,268 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:18,269 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:18,270 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:18,270 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,270 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,270 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:18,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:18,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:18,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:18,274 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:18,274 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:18,274 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:18,274 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,274 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:18,276 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,276 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:18,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:18,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,276 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:18,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,276 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:18,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:18,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:18,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:18,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,278 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:18,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,280 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,280 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:18,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:18,280 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:18,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:18,280 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,280 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,280 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:18,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:18,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:18,280 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,281 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:18,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-04 17:53:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:18,281 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,282 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,282 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:18,282 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:18,382 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:18,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:18,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:18,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:18,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,395 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:18,395 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:18,396 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:18,396 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:18,396 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,397 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,397 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,397 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:18,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:18,398 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:18,398 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,399 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,399 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:18,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:18,399 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:18,399 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:18,399 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:18,399 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:18,399 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:18,400 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:18,400 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:18,400 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:18,829 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cc7a75f91904463b8527c0432417b335 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907cc7a75f91904463b8527c0432417b335 2023-04-04 17:53:19,238 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/c716f3f2daac46319becf771423db002 2023-04-04 17:53:19,253 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/c716f3f2daac46319becf771423db002 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/c716f3f2daac46319becf771423db002 2023-04-04 17:53:19,261 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/c716f3f2daac46319becf771423db002, entries=1, sequenceid=37, filesize=5.0 K 2023-04-04 17:53:19,262 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 862ms, sequenceid=37, compaction requested=true 2023-04-04 17:53:19,263 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:19,263 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:19,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:19,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:19,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:19,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:19,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,265 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:19,265 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,265 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:19,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:19,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26f771ca[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:19,267 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:19,267 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,267 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,267 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:19,267 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:19,268 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:19,268 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,268 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:19,268 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,268 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:19,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:19,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:19,268 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:19,269 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:19,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:19,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:19,271 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:19,271 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:19,271 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:19,271 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,271 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:19,272 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,272 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,272 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:19,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:19,273 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,274 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,276 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,276 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,277 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,277 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,277 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:19,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:19,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:19,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:19,277 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:19,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-04 17:53:19,277 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:19,277 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:19,277 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:19,278 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:19,278 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,278 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,378 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:19,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:19,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:19,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:19,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,395 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:19,395 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:19,395 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-04 17:53:19,395 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-04 17:53:19,396 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,396 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,397 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:19,397 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:19,397 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:19,397 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,398 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-04 17:53:19,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:19,398 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-04 17:53:19,398 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:19,399 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-04 17:53:19,400 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:19,400 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:19,400 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:19,400 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. started... 2023-04-04 17:53:19,400 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d720ad2c4dc903c0b50df1d59f3ccf5 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:19,825 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200c4cc0a168ad44589b04c5e05c517d8a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511200c4cc0a168ad44589b04c5e05c517d8a 2023-04-04 17:53:20,234 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/7b41a75263f342a3bc7e9f156b41480f 2023-04-04 17:53:20,250 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/7b41a75263f342a3bc7e9f156b41480f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7b41a75263f342a3bc7e9f156b41480f 2023-04-04 17:53:20,256 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7b41a75263f342a3bc7e9f156b41480f, entries=1, sequenceid=41, filesize=5.0 K 2023-04-04 17:53:20,257 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d720ad2c4dc903c0b50df1d59f3ccf5 in 857ms, sequenceid=41, compaction requested=true 2023-04-04 17:53:20,257 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:20,257 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:20,257 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:20,258 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:20,258 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,258 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-04 17:53:20,258 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-04 17:53:20,259 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,259 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:20,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:20,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-04 17:53:20,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17e25825[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:20,261 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-04 17:53:20,261 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,263 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-04 17:53:20,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-04 17:53:20,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:20,263 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:20,264 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-04 17:53:20,264 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,264 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,264 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-04 17:53:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:20,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-04 17:53:20,268 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-04 17:53:20,268 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:20,268 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:20,268 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,268 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:20,269 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,269 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,269 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:20,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:20,270 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,273 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:20,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-04 17:53:20,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-04 17:53:20,275 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:20,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,275 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:20,376 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:20,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:20,385 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-04-04 17:53:20,388 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-04-04 17:53:20,389 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:20,401 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-04 17:53:20,401 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-04 17:53:20,403 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:20,403 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631400403 2023-04-04 17:53:20,406 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:53:20,410 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-04-04 17:53:20,410 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:20,411 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x3841bb2d to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:20,433 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38968550, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:20,436 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:20,909 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ddfcb0faa0ef41ccafde0fc66608980e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ddfcb0faa0ef41ccafde0fc66608980e 2023-04-04 17:53:20,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:20,926 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:20,927 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:20,938 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:53:20,940 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:53:20,972 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a373c016ba8242acbede272d3145b084 first=Optional[r3] last=Optional[r6] 2023-04-04 17:53:20,984 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a373c016ba8242acbede272d3145b084}] 2023-04-04 17:53:20,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a373c016ba8242acbede272d3145b084 for inclusion in 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:21,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-04 17:53:21,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:21,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:21,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a373c016ba8242acbede272d3145b084 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dri03ras2p13um5vj2f7bfjvqh8t4utdah4l5khjkihq44vjqon5qa8khr3k0uqg/family1/a373c016ba8242acbede272d3145b084 2023-04-04 17:53:21,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dri03ras2p13um5vj2f7bfjvqh8t4utdah4l5khjkihq44vjqon5qa8khr3k0uqg/family1/a373c016ba8242acbede272d3145b084 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_ 2023-04-04 17:53:21,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dri03ras2p13um5vj2f7bfjvqh8t4utdah4l5khjkihq44vjqon5qa8khr3k0uqg/family1/a373c016ba8242acbede272d3145b084 into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_ - updating store file list. 2023-04-04 17:53:21,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_ into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:21,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dri03ras2p13um5vj2f7bfjvqh8t4utdah4l5khjkihq44vjqon5qa8khr3k0uqg/family1/a373c016ba8242acbede272d3145b084 into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_) 2023-04-04 17:53:21,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dri03ras2p13um5vj2f7bfjvqh8t4utdah4l5khjkihq44vjqon5qa8khr3k0uqg/family1/a373c016ba8242acbede272d3145b084 2023-04-04 17:53:21,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-04 17:53:21,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-04 17:53:21,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 is initiating minor compaction 2023-04-04 17:53:21,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4333bd0d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:21,030 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:21,030 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/a079d9cb4b514936a950d9112decfee1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7687c23c958942dd9828413d40bac54f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ef0674dbdc5c4c73b3fd91f904d6190a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/2fa4879c52504819b599df3d77242329, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/1d85facfdb6a485b86404d5daa55e12c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fd0dae5034fd427eaa940392c4d9b0f6, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/e1a74950bc204874b60e9fcbdf14f46d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/c716f3f2daac46319becf771423db002, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7b41a75263f342a3bc7e9f156b41480f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp, totalSize=50.2 K 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting a079d9cb4b514936a950d9112decfee1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 7687c23c958942dd9828413d40bac54f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting ef0674dbdc5c4c73b3fd91f904d6190a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 2fa4879c52504819b599df3d77242329, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 1d85facfdb6a485b86404d5daa55e12c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting fd0dae5034fd427eaa940392c4d9b0f6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting e1a74950bc204874b60e9fcbdf14f46d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting c716f3f2daac46319becf771423db002, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-04 17:53:21,031 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 7b41a75263f342a3bc7e9f156b41480f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-04 17:53:21,032 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting ff8950279bca4874b6b12d76878c4e2f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-04 17:53:21,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:21,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:21,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e6b8f26bf2d04a6987db67dcbe9e4164 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e6b8f26bf2d04a6987db67dcbe9e4164 2023-04-04 17:53:21,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e72fcccc819c4a45aa2ee426fe9f4904 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e72fcccc819c4a45aa2ee426fe9f4904 2023-04-04 17:53:21,055 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9d6542757524c20b665ad8248dfbb1c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9d6542757524c20b665ad8248dfbb1c 2023-04-04 17:53:21,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010356b434d7dc6f4e379db5b442d8a9b05a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010356b434d7dc6f4e379db5b442d8a9b05a 2023-04-04 17:53:21,057 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-04-04 17:53:21,057 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:21,091 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1d720ad2c4dc903c0b50df1d59f3ccf5#family1#compaction#10 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:53:21,922 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/fc0293e393c1400683ea552b1a4769a7 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fc0293e393c1400683ea552b1a4769a7 2023-04-04 17:53:21,941 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 of 1d720ad2c4dc903c0b50df1d59f3ccf5 into fc0293e393c1400683ea552b1a4769a7(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:53:21,941 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:21,943 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1680630801027; duration=0sec 2023-04-04 17:53:21,943 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:21,952 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ac606c98f0904327ab94088c5122d43c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ac606c98f0904327ab94088c5122d43c 2023-04-04 17:53:21,954 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:21,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/a079d9cb4b514936a950d9112decfee1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7687c23c958942dd9828413d40bac54f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ef0674dbdc5c4c73b3fd91f904d6190a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/2fa4879c52504819b599df3d77242329, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/1d85facfdb6a485b86404d5daa55e12c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fd0dae5034fd427eaa940392c4d9b0f6, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/e1a74950bc204874b60e9fcbdf14f46d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/c716f3f2daac46319becf771423db002, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7b41a75263f342a3bc7e9f156b41480f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_] to archive 2023-04-04 17:53:21,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:21,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/a079d9cb4b514936a950d9112decfee1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/a079d9cb4b514936a950d9112decfee1 2023-04-04 17:53:21,988 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/560bc21dc5ff42c78127ef7c4194c80c first=Optional[r00] last=Optional[r2] 2023-04-04 17:53:21,989 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/560bc21dc5ff42c78127ef7c4194c80c}] 2023-04-04 17:53:21,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7687c23c958942dd9828413d40bac54f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7687c23c958942dd9828413d40bac54f 2023-04-04 17:53:21,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/560bc21dc5ff42c78127ef7c4194c80c for inclusion in 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:21,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ef0674dbdc5c4c73b3fd91f904d6190a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ef0674dbdc5c4c73b3fd91f904d6190a 2023-04-04 17:53:21,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/2fa4879c52504819b599df3d77242329 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/2fa4879c52504819b599df3d77242329 2023-04-04 17:53:21,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/1d85facfdb6a485b86404d5daa55e12c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/1d85facfdb6a485b86404d5daa55e12c 2023-04-04 17:53:21,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-04 17:53:21,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:21,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:21,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/560bc21dc5ff42c78127ef7c4194c80c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mmkictnhamalumk78j7uaqmtgehk16kdlh84fvksubn3softnflrc4p98mmaea54/family1/560bc21dc5ff42c78127ef7c4194c80c 2023-04-04 17:53:22,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fd0dae5034fd427eaa940392c4d9b0f6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fd0dae5034fd427eaa940392c4d9b0f6 2023-04-04 17:53:22,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/e1a74950bc204874b60e9fcbdf14f46d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/e1a74950bc204874b60e9fcbdf14f46d 2023-04-04 17:53:22,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mmkictnhamalumk78j7uaqmtgehk16kdlh84fvksubn3softnflrc4p98mmaea54/family1/560bc21dc5ff42c78127ef7c4194c80c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_ 2023-04-04 17:53:22,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mmkictnhamalumk78j7uaqmtgehk16kdlh84fvksubn3softnflrc4p98mmaea54/family1/560bc21dc5ff42c78127ef7c4194c80c into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_ - updating store file list. 2023-04-04 17:53:22,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/c716f3f2daac46319becf771423db002 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/c716f3f2daac46319becf771423db002 2023-04-04 17:53:22,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7b41a75263f342a3bc7e9f156b41480f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/7b41a75263f342a3bc7e9f156b41480f 2023-04-04 17:53:22,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/ff8950279bca4874b6b12d76878c4e2f_SeqId_44_ 2023-04-04 17:53:22,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_ into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:22,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mmkictnhamalumk78j7uaqmtgehk16kdlh84fvksubn3softnflrc4p98mmaea54/family1/560bc21dc5ff42c78127ef7c4194c80c into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_) 2023-04-04 17:53:22,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mmkictnhamalumk78j7uaqmtgehk16kdlh84fvksubn3softnflrc4p98mmaea54/family1/560bc21dc5ff42c78127ef7c4194c80c 2023-04-04 17:53:22,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:53:22,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:53:22,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 is initiating minor compaction (all files) 2023-04-04 17:53:22,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bd1e6de; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:22,023 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:22,023 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/6be1b8361e0344cebd7a0dbe47f0c993, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fc0293e393c1400683ea552b1a4769a7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp, totalSize=358.6 K 2023-04-04 17:53:22,024 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 6be1b8361e0344cebd7a0dbe47f0c993, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809546 2023-04-04 17:53:22,024 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting fc0293e393c1400683ea552b1a4769a7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209546 2023-04-04 17:53:22,025 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting da2a66621168414d9723d1a70a5d116e_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809546 2023-04-04 17:53:22,026 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:22,027 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:22,029 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130ac552f76d10542f18a31f302e66d0ff1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130ac552f76d10542f18a31f302e66d0ff1 2023-04-04 17:53:22,031 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512011d1ea500e9c54dcdadbf868221510fb2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512011d1ea500e9c54dcdadbf868221510fb2 2023-04-04 17:53:22,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055a93d576ec2d492ba0ef11c4bab251c2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055a93d576ec2d492ba0ef11c4bab251c2 2023-04-04 17:53:22,032 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-04-04 17:53:22,032 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-04 17:53:22,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:22,033 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:22,033 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:22,034 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-04 17:53:22,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6410 sec 2023-04-04 17:53:22,076 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1d720ad2c4dc903c0b50df1d59f3ccf5#family1#compaction#11 average throughput is 4.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:53:22,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-04 17:53:22,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:22,630 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-04-04 17:53:22,634 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:22,634 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-04-04 17:53:22,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-04-04 17:53:22,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, REOPEN/MOVE}] 2023-04-04 17:53:22,657 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, REOPEN/MOVE 2023-04-04 17:53:22,658 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1d720ad2c4dc903c0b50df1d59f3ccf5, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:22,659 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680630802658"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630802658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630802658"}]},"ts":"1680630802658"} 2023-04-04 17:53:22,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 1d720ad2c4dc903c0b50df1d59f3ccf5, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:22,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:22,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1d720ad2c4dc903c0b50df1d59f3ccf5, disabling compactions & flushes 2023-04-04 17:53:22,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,335 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/.tmp/family1/8be56588486e45cb8a60d6ef8dac60cb as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/8be56588486e45cb8a60d6ef8dac60cb 2023-04-04 17:53:23,343 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 of 1d720ad2c4dc903c0b50df1d59f3ccf5 into 8be56588486e45cb8a60d6ef8dac60cb(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:53:23,343 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:23,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. after waiting 0 ms 2023-04-04 17:53:23,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,343 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1680630802023; duration=1sec 2023-04-04 17:53:23,343 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:23,345 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/6be1b8361e0344cebd7a0dbe47f0c993, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fc0293e393c1400683ea552b1a4769a7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_] to archive 2023-04-04 17:53:23,346 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:23,348 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/6be1b8361e0344cebd7a0dbe47f0c993 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/6be1b8361e0344cebd7a0dbe47f0c993 2023-04-04 17:53:23,350 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fc0293e393c1400683ea552b1a4769a7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/fc0293e393c1400683ea552b1a4769a7 2023-04-04 17:53:23,352 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/da2a66621168414d9723d1a70a5d116e_SeqId_47_ 2023-04-04 17:53:23,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-04 17:53:23,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:23,360 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1d720ad2c4dc903c0b50df1d59f3ccf5 to self. 2023-04-04 17:53:23,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1d720ad2c4dc903c0b50df1d59f3ccf5, regionState=CLOSED 2023-04-04 17:53:23,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680630803363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630803363"}]},"ts":"1680630803363"} 2023-04-04 17:53:23,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-04-04 17:53:23,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 1d720ad2c4dc903c0b50df1d59f3ccf5, server=jenkins-hbase17.apache.org,46251,1680630785259 in 704 msec 2023-04-04 17:53:23,369 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=true 2023-04-04 17:53:23,519 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1d720ad2c4dc903c0b50df1d59f3ccf5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:23,520 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680630803519"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630803519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630803519"}]},"ts":"1680630803519"} 2023-04-04 17:53:23,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 1d720ad2c4dc903c0b50df1d59f3ccf5, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:23,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1d720ad2c4dc903c0b50df1d59f3ccf5, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:23,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:23,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,687 INFO [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,689 DEBUG [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:23,689 DEBUG [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:23,690 INFO [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d720ad2c4dc903c0b50df1d59f3ccf5 columnFamilyName family1 2023-04-04 17:53:23,701 DEBUG [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/8be56588486e45cb8a60d6ef8dac60cb 2023-04-04 17:53:23,702 INFO [StoreOpener-1d720ad2c4dc903c0b50df1d59f3ccf5-1] regionserver.HStore(310): Store=1d720ad2c4dc903c0b50df1d59f3ccf5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:23,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:53:23,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1d720ad2c4dc903c0b50df1d59f3ccf5; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70456750, jitterRate=0.049887388944625854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:53:23,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:23,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5., pid=17, masterSystemTime=1680630803677 2023-04-04 17:53:23,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:53:23,716 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1d720ad2c4dc903c0b50df1d59f3ccf5, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:23,717 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680630803716"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630803716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630803716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630803716"}]},"ts":"1680630803716"} 2023-04-04 17:53:23,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-04-04 17:53:23,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 1d720ad2c4dc903c0b50df1d59f3ccf5, server=jenkins-hbase17.apache.org,46251,1680630785259 in 196 msec 2023-04-04 17:53:23,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-04-04 17:53:23,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1d720ad2c4dc903c0b50df1d59f3ccf5, REOPEN/MOVE in 1.0670 sec 2023-04-04 17:53:23,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-04-04 17:53:23,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0890 sec 2023-04-04 17:53:23,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.5270 sec 2023-04-04 17:53:23,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-04-04 17:53:23,749 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(278): alter status finished 2023-04-04 17:53:23,750 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-04 17:53:23,753 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-04 17:53:23,753 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-04 17:53:23,755 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:23,755 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631403755 2023-04-04 17:53:23,756 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:53:23,756 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-04-04 17:53:23,756 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:23,757 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x78ba07c3 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:23,766 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c9917ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:23,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:23,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:23,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:23,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:23,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:24,206 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f5c4b28954be4c6290b465670c807f25 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f5c4b28954be4c6290b465670c807f25 2023-04-04 17:53:24,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:24,224 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:24,225 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:24,233 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:53:24,235 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:53:24,248 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f46dae60a92426fa2b6e8e549f43a94 first=Optional[r05] last=Optional[r8] 2023-04-04 17:53:24,249 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f46dae60a92426fa2b6e8e549f43a94}] 2023-04-04 17:53:24,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f46dae60a92426fa2b6e8e549f43a94 for inclusion in 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:24,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-04-04 17:53:24,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:24,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:53:24,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f46dae60a92426fa2b6e8e549f43a94 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sf2tsipmfrmb54fms9nfuljgev4g6rkk0cdroeoiu6scvcmsmfrshnkusag46n89/family1/5f46dae60a92426fa2b6e8e549f43a94 2023-04-04 17:53:24,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sf2tsipmfrmb54fms9nfuljgev4g6rkk0cdroeoiu6scvcmsmfrshnkusag46n89/family1/5f46dae60a92426fa2b6e8e549f43a94 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/67006ac6300e4d9ea79b038c3cf5ce44_SeqId_53_ 2023-04-04 17:53:24,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sf2tsipmfrmb54fms9nfuljgev4g6rkk0cdroeoiu6scvcmsmfrshnkusag46n89/family1/5f46dae60a92426fa2b6e8e549f43a94 into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/67006ac6300e4d9ea79b038c3cf5ce44_SeqId_53_ - updating store file list. 2023-04-04 17:53:24,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/67006ac6300e4d9ea79b038c3cf5ce44_SeqId_53_ into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 2023-04-04 17:53:24,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sf2tsipmfrmb54fms9nfuljgev4g6rkk0cdroeoiu6scvcmsmfrshnkusag46n89/family1/5f46dae60a92426fa2b6e8e549f43a94 into 1d720ad2c4dc903c0b50df1d59f3ccf5/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/family1/67006ac6300e4d9ea79b038c3cf5ce44_SeqId_53_) 2023-04-04 17:53:24,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sf2tsipmfrmb54fms9nfuljgev4g6rkk0cdroeoiu6scvcmsmfrshnkusag46n89/family1/5f46dae60a92426fa2b6e8e549f43a94 2023-04-04 17:53:24,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:24,278 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:24,280 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511200c4cc0a168ad44589b04c5e05c517d8a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511200c4cc0a168ad44589b04c5e05c517d8a 2023-04-04 17:53:24,281 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d7249bcf59b546609baf88b029b7c17a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d7249bcf59b546609baf88b029b7c17a 2023-04-04 17:53:24,281 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-04-04 17:53:24,281 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-04 17:53:24,282 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:24,282 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:24,282 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-04 17:53:24,282 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-04 17:53:24,282 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:24,283 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-04 17:53:24,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 532 msec 2023-04-04 17:53:24,370 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=248 (was 210) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56118 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x3841bb2d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1717549233.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x78ba07c3-SendThread(127.0.0.1:61441) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x2db284b1-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56170 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56102 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x78ba07c3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1717549233.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1595161031_15 at /127.0.0.1:56110 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56152 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x78ba07c3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56128 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x3841bb2d-SendThread(127.0.0.1:61441) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:38324 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:38370 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x3841bb2d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56230 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2db284b1-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase17:46251-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56208 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x124315a9-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56174 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56080 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56260 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56098 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x124315a9-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:56204 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2db284b1-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=591 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=302 (was 388), ProcessCount=173 (was 173), AvailableMemoryMB=7803 (was 7934) 2023-04-04 17:53:24,384 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=591, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=173, AvailableMemoryMB=7802 2023-04-04 17:53:24,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-04 17:53:24,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:24,389 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:53:24,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-04-04 17:53:24,390 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:53:24,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-04 17:53:24,391 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:24,392 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211 empty. 2023-04-04 17:53:24,392 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:24,392 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-04-04 17:53:24,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-04 17:53:24,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-04 17:53:24,804 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:24,807 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => fbcdf4e9a177d06d96f6c07ba7d9a211, NAME => 'testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:24,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-04 17:53:25,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:25,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing fbcdf4e9a177d06d96f6c07ba7d9a211, disabling compactions & flushes 2023-04-04 17:53:25,218 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:25,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:25,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. after waiting 0 ms 2023-04-04 17:53:25,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:25,218 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:25,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:25,222 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:53:25,225 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680630805225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630805225"}]},"ts":"1680630805225"} 2023-04-04 17:53:25,228 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:53:25,230 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:53:25,231 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630805231"}]},"ts":"1680630805231"} 2023-04-04 17:53:25,233 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-04-04 17:53:25,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=fbcdf4e9a177d06d96f6c07ba7d9a211, ASSIGN}] 2023-04-04 17:53:25,237 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=fbcdf4e9a177d06d96f6c07ba7d9a211, ASSIGN 2023-04-04 17:53:25,237 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=fbcdf4e9a177d06d96f6c07ba7d9a211, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:25,389 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=fbcdf4e9a177d06d96f6c07ba7d9a211, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:25,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680630805389"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630805389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630805389"}]},"ts":"1680630805389"} 2023-04-04 17:53:25,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure fbcdf4e9a177d06d96f6c07ba7d9a211, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:25,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-04 17:53:25,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:25,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fbcdf4e9a177d06d96f6c07ba7d9a211, NAME => 'testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:25,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:25,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:25,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:25,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:25,562 INFO [StoreOpener-fbcdf4e9a177d06d96f6c07ba7d9a211-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:25,564 DEBUG [StoreOpener-fbcdf4e9a177d06d96f6c07ba7d9a211-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:25,564 DEBUG [StoreOpener-fbcdf4e9a177d06d96f6c07ba7d9a211-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:25,565 INFO [StoreOpener-fbcdf4e9a177d06d96f6c07ba7d9a211-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbcdf4e9a177d06d96f6c07ba7d9a211 columnFamilyName family1 2023-04-04 17:53:25,567 INFO [StoreOpener-fbcdf4e9a177d06d96f6c07ba7d9a211-1] regionserver.HStore(310): Store=fbcdf4e9a177d06d96f6c07ba7d9a211/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:25,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:53:25,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:25,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fbcdf4e9a177d06d96f6c07ba7d9a211; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65090245, jitterRate=-0.030079767107963562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:53:25,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:25,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211., pid=21, masterSystemTime=1680630805550 2023-04-04 17:53:25,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:25,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:25,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=fbcdf4e9a177d06d96f6c07ba7d9a211, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:25,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680630805578"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630805578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630805578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630805578"}]},"ts":"1680630805578"} 2023-04-04 17:53:25,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-04-04 17:53:25,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure fbcdf4e9a177d06d96f6c07ba7d9a211, server=jenkins-hbase17.apache.org,46251,1680630785259 in 184 msec 2023-04-04 17:53:25,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-04-04 17:53:25,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=fbcdf4e9a177d06d96f6c07ba7d9a211, ASSIGN in 346 msec 2023-04-04 17:53:25,584 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:53:25,584 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630805584"}]},"ts":"1680630805584"} 2023-04-04 17:53:25,585 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-04-04 17:53:25,588 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:53:25,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2020 sec 2023-04-04 17:53:26,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-04 17:53:26,502 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-04-04 17:53:26,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:26,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,538 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:26,538 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:26,538 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:26,538 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:26,539 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,539 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,539 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:26,540 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:26,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:26,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:26,540 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:26,540 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:26,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:26,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,541 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,541 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:26,541 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:26,541 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:26,541 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:26,541 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:26,541 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:26,541 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:26,542 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-04 17:53:26,973 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130680de2a8eeb04db4b0eadc1b0dfee14b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130680de2a8eeb04db4b0eadc1b0dfee14b 2023-04-04 17:53:26,980 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/b7eba0d72bff43789be4abc5150fbd65 2023-04-04 17:53:26,987 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/b7eba0d72bff43789be4abc5150fbd65 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/b7eba0d72bff43789be4abc5150fbd65 2023-04-04 17:53:26,993 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/b7eba0d72bff43789be4abc5150fbd65, entries=1000, sequenceid=5, filesize=166.0 K 2023-04-04 17:53:26,995 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 452ms, sequenceid=5, compaction requested=false 2023-04-04 17:53:26,995 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:26,996 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:26,996 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:26,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:26,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:26,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:26,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:26,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:26,997 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:26,997 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:26,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:26,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:26,998 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,998 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:26,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:26,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:27,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:27,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@519f556f[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:27,000 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:27,000 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,000 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:27,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:27,001 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,001 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:27,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:27,002 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,002 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:27,002 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:27,002 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:27,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:27,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:27,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:27,006 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:27,006 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:27,006 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:27,006 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,006 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:27,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:27,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,008 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:27,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:27,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,009 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,011 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,011 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,011 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:27,011 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:27,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:27,011 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,011 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:27,011 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:27,011 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:27,012 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:27,012 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:27,012 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,012 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:27,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:27,112 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:27,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:27,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:27,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:27,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,130 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:27,130 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:27,131 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:27,131 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:27,132 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,132 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,134 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:27,134 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:27,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:27,135 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,135 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:27,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,136 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,137 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:27,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,137 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:27,137 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:27,138 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:27,138 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:27,138 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:27,138 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:27,138 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:27,138 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-04 17:53:27,565 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112894f6c398a5964258919b82f6de216814 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112894f6c398a5964258919b82f6de216814 2023-04-04 17:53:27,974 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/a202aca01bee4505b933162a0b4db7ff 2023-04-04 17:53:27,982 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/a202aca01bee4505b933162a0b4db7ff as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/a202aca01bee4505b933162a0b4db7ff 2023-04-04 17:53:27,988 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/a202aca01bee4505b933162a0b4db7ff, entries=1, sequenceid=9, filesize=5.0 K 2023-04-04 17:53:27,989 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 851ms, sequenceid=9, compaction requested=false 2023-04-04 17:53:27,990 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:27,990 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:27,990 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:27,990 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:27,990 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,990 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:27,990 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:27,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,991 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:27,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:27,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:27,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f231a84[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:27,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:27,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,994 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:27,994 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:27,994 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:27,994 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,994 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:27,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:27,995 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:27,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:27,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:27,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:27,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:27,998 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:27,998 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:27,998 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:27,998 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,998 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:27,999 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,999 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,999 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:27,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:28,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:28,000 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,002 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,006 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:28,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:28,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:28,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:28,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:28,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,008 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:28,008 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:28,008 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:28,007 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:28,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:28,108 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:28,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:28,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:28,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:28,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,122 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:28,122 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:28,123 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:28,123 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:28,123 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,123 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,125 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,125 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:28,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:28,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:28,125 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,125 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:28,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:28,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,127 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,127 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:28,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,127 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:28,127 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:28,128 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:28,128 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:28,128 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:28,128 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:28,128 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:28,128 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:28,554 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201db45596540d44fe899203f7da54b1e18 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201db45596540d44fe899203f7da54b1e18 2023-04-04 17:53:28,903 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:53:28,963 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/452f1b51452d4f61b397781dde2152d0 2023-04-04 17:53:28,972 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/452f1b51452d4f61b397781dde2152d0 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/452f1b51452d4f61b397781dde2152d0 2023-04-04 17:53:28,978 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/452f1b51452d4f61b397781dde2152d0, entries=1, sequenceid=13, filesize=4.9 K 2023-04-04 17:53:28,979 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 851ms, sequenceid=13, compaction requested=true 2023-04-04 17:53:28,979 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:28,979 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:28,979 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:28,979 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:28,979 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,979 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:28,979 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:28,980 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,980 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:28,981 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,981 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:28,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:28,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72c75f8b[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:28,982 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:28,982 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,983 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,983 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:28,983 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:28,983 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:28,983 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,983 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:28,984 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:28,984 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:28,984 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,984 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:28,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:28,987 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:28,987 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:28,987 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:28,987 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,987 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:28,988 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,989 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:28,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,989 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:28,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:28,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:28,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,992 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,992 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,992 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,992 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:28,992 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:28,992 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:28,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:28,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:28,993 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:28,992 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:28,993 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:28,993 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:28,993 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:28,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:28,993 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:28,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:28,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:29,094 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:29,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:29,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:29,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:29,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,108 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:29,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:29,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:29,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:29,109 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,109 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,110 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,110 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:29,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:29,110 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,110 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,111 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,111 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:29,111 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:29,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:29,112 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:29,112 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:29,112 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:29,112 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:29,112 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:29,112 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:29,535 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053ac7c5f0c62a4efcafa9cd45e8ea2323 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053ac7c5f0c62a4efcafa9cd45e8ea2323 2023-04-04 17:53:29,945 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/261128670a214629930babbfde6cdfa5 2023-04-04 17:53:29,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/261128670a214629930babbfde6cdfa5 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/261128670a214629930babbfde6cdfa5 2023-04-04 17:53:29,968 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/261128670a214629930babbfde6cdfa5, entries=1, sequenceid=17, filesize=4.9 K 2023-04-04 17:53:29,969 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 857ms, sequenceid=17, compaction requested=true 2023-04-04 17:53:29,969 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:29,969 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:29,969 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:29,969 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:29,969 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,970 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:29,970 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:29,971 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,971 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:29,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:29,972 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:29,972 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:29,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:29,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:29,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:29,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77e10286[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:29,974 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:29,974 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,975 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,975 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:29,975 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:29,975 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,975 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:29,975 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:29,976 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,976 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:29,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:29,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:29,976 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:29,977 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:29,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:29,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:29,981 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:29,981 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:29,981 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:29,981 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,981 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:29,982 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,982 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:29,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,982 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:29,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:29,983 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:29,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,984 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:29,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,985 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:29,985 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:29,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:29,986 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:29,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:29,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:29,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:29,986 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:29,987 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:29,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:30,087 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:30,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:30,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:30,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:30,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,099 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:30,099 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:30,099 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:30,099 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:30,100 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,100 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,101 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,101 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:30,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:30,101 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,101 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,102 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,102 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:30,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,102 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:30,102 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:30,103 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:30,103 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:30,103 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:30,103 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:30,103 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:30,103 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:30,522 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228afc7621e241e4463942fc881db6e585b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228afc7621e241e4463942fc881db6e585b 2023-04-04 17:53:30,932 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/8b3aa6772ded41bca683d1cdff10ea6f 2023-04-04 17:53:30,946 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/8b3aa6772ded41bca683d1cdff10ea6f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/8b3aa6772ded41bca683d1cdff10ea6f 2023-04-04 17:53:30,954 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/8b3aa6772ded41bca683d1cdff10ea6f, entries=1, sequenceid=21, filesize=4.9 K 2023-04-04 17:53:30,955 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 852ms, sequenceid=21, compaction requested=true 2023-04-04 17:53:30,955 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:30,955 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:30,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:30,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:30,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:30,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:30,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,957 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:30,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:30,957 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,957 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:30,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:30,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:30,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cfe1538[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:30,959 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:30,959 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,959 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:30,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:30,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:30,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:30,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:30,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:30,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:30,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:30,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:30,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:30,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:30,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:30,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:30,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:30,964 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:30,964 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:30,964 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:30,964 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,965 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:30,967 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,967 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:30,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,967 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:30,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:30,967 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:30,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:30,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:30,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:30,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:30,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,971 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,971 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:30,971 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:30,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:30,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:30,971 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:30,971 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,971 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:30,972 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:30,972 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:30,972 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:30,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:30,972 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:30,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:30,972 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:30,973 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,073 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:31,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:31,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:31,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:31,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,089 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:31,089 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:31,090 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:31,090 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:31,091 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,091 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,092 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,092 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:31,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:31,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:31,092 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,092 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:31,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,094 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,094 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:31,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,094 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:31,094 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:31,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:31,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:31,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:31,095 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:31,095 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:31,095 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:31,520 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fad1f371fced40aa8a76ed769011c0da to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fad1f371fced40aa8a76ed769011c0da 2023-04-04 17:53:31,928 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/3933159ee63648db9b1236f338f0fc3d 2023-04-04 17:53:31,940 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/3933159ee63648db9b1236f338f0fc3d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/3933159ee63648db9b1236f338f0fc3d 2023-04-04 17:53:31,947 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/3933159ee63648db9b1236f338f0fc3d, entries=1, sequenceid=25, filesize=4.9 K 2023-04-04 17:53:31,948 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 853ms, sequenceid=25, compaction requested=true 2023-04-04 17:53:31,948 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:31,948 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:31,948 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:31,948 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:31,948 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,948 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:31,948 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:31,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,950 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:31,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:31,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:31,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:31,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bfed319[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:31,951 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:31,951 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,952 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:31,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:31,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:31,952 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,952 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:31,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:31,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:31,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:31,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:31,956 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:31,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:31,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:31,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,956 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:31,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:31,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:31,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:31,957 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,959 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:31,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:31,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:31,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:31,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:31,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:31,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:31,960 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:31,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,961 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:31,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:31,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:31,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,061 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:32,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:32,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:32,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,079 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:32,079 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:32,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:32,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:32,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,081 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,081 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:32,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:32,081 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,081 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,082 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,082 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:32,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,082 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:32,082 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:32,083 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:32,083 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:32,083 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:32,083 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:32,083 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:32,083 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:32,509 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010186aa3ab2121c4817a309b41051499bed to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010186aa3ab2121c4817a309b41051499bed 2023-04-04 17:53:32,917 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/da1102d249b6408e89c25102d3f13ffc 2023-04-04 17:53:32,930 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/da1102d249b6408e89c25102d3f13ffc as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/da1102d249b6408e89c25102d3f13ffc 2023-04-04 17:53:32,936 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/da1102d249b6408e89c25102d3f13ffc, entries=1, sequenceid=29, filesize=4.9 K 2023-04-04 17:53:32,937 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 854ms, sequenceid=29, compaction requested=true 2023-04-04 17:53:32,937 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:32,937 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:32,937 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:32,937 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:32,938 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,938 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:32,938 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:32,939 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,939 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:32,939 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:32,939 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:32,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:32,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@638dfaea[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:32,941 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:32,941 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,942 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,942 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:32,942 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:32,942 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,942 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:32,942 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:32,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:32,944 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:32,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:32,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:32,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:32,948 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:32,948 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:32,948 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:32,948 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,948 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:32,949 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,949 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,949 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,950 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:32,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,951 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:32,953 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:32,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:32,954 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:32,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:32,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:32,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:32,954 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:32,954 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:33,054 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:33,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:33,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:33,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,067 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:33,067 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:33,067 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:33,067 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:33,068 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,068 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,069 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:33,069 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:33,070 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,070 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,071 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:33,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,073 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:33,073 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:33,073 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:33,073 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:33,074 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:33,074 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:33,074 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:33,074 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:33,493 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103469ac665749549b6b8db4dd067e50b89 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103469ac665749549b6b8db4dd067e50b89 2023-04-04 17:53:33,900 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/680b8ab98f0f4705b2d8e561d0d286ec 2023-04-04 17:53:33,913 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/680b8ab98f0f4705b2d8e561d0d286ec as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/680b8ab98f0f4705b2d8e561d0d286ec 2023-04-04 17:53:33,920 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/680b8ab98f0f4705b2d8e561d0d286ec, entries=1, sequenceid=33, filesize=4.9 K 2023-04-04 17:53:33,921 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 847ms, sequenceid=33, compaction requested=true 2023-04-04 17:53:33,921 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:33,921 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:33,921 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:33,922 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:33,922 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,922 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:33,922 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:33,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,923 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:33,924 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,924 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:33,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:33,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c07212f[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:33,926 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:33,926 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,928 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:33,928 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:33,928 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:33,929 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,929 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:33,929 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:33,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,929 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:33,930 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:33,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:33,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:33,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:33,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:33,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:33,934 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:33,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:33,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:33,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,934 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:33,936 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,936 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:33,936 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:33,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:33,937 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,939 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:33,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:33,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:33,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:33,942 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:33,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:33,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:33,942 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:33,942 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,942 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:33,943 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,943 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:33,943 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,943 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:33,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:33,943 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:34,044 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:34,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:34,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:34,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:34,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,058 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:34,058 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:34,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:34,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:34,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,060 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,060 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:34,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:34,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:34,060 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,060 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:34,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:34,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,063 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:34,063 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:34,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:34,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:34,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:34,064 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:34,064 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:34,064 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:34,497 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907657aa6daa4f54f1db1778da59e6dc81d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907657aa6daa4f54f1db1778da59e6dc81d 2023-04-04 17:53:34,904 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/e3bbc3e370264e8bae418e65abe2aec4 2023-04-04 17:53:34,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/e3bbc3e370264e8bae418e65abe2aec4 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/e3bbc3e370264e8bae418e65abe2aec4 2023-04-04 17:53:34,917 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/e3bbc3e370264e8bae418e65abe2aec4, entries=1, sequenceid=37, filesize=4.9 K 2023-04-04 17:53:34,918 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 854ms, sequenceid=37, compaction requested=true 2023-04-04 17:53:34,918 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:34,918 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:34,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:34,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:34,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:34,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:34,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,919 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:34,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:34,920 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,920 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:34,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:34,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:34,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:34,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:34,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30fcb042[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:34,922 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:34,922 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,923 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:34,923 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:34,923 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:34,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:34,924 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:34,924 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:34,924 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,924 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:34,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:34,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:34,927 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:34,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:34,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:34,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,928 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:34,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:34,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:34,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:34,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:34,929 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,931 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,932 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:34,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:34,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:34,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:34,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:34,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,933 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:34,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:34,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:34,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,934 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:34,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:34,934 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:34,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:34,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:35,034 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:35,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:35,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:35,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:35,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,051 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:35,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:35,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:53:35,052 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:35,052 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,053 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,054 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,054 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:35,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:35,055 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,055 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,057 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:53:35,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,057 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:53:35,057 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:35,058 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:53:35,059 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:35,059 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:35,059 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:35,059 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. started... 2023-04-04 17:53:35,059 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbcdf4e9a177d06d96f6c07ba7d9a211 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:35,484 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e0a6fb6216f5415495ebde968bf5f5ed to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e0a6fb6216f5415495ebde968bf5f5ed 2023-04-04 17:53:35,893 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/c77fc656de244af29332d8a12c17c235 2023-04-04 17:53:35,906 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/c77fc656de244af29332d8a12c17c235 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/c77fc656de244af29332d8a12c17c235 2023-04-04 17:53:35,915 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/c77fc656de244af29332d8a12c17c235, entries=1, sequenceid=41, filesize=4.9 K 2023-04-04 17:53:35,916 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fbcdf4e9a177d06d96f6c07ba7d9a211 in 857ms, sequenceid=41, compaction requested=true 2023-04-04 17:53:35,916 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:35,916 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:35,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:35,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:35,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:53:35,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:53:35,917 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:35,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:35,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:35,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:35,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:35,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:35,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:53:35,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dc7cb5f[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:35,919 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:35,919 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,920 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:35,920 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:53:35,920 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,920 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:35,920 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:35,921 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,921 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:53:35,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:35,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:35,921 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:35,921 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:53:35,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:35,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:35,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:35,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:35,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:35,923 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:53:35,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:35,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:35,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,923 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:35,924 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,924 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:35,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,924 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:35,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:35,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:35,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:35,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,926 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,926 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:35,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-04 17:53:35,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:35,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:53:35,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:35,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:35,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:35,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:35,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:35,928 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:35,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,929 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:35,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:35,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:35,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:35,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:36,029 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:36,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:36,036 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-04-04 17:53:36,039 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:53:36,040 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:53:36,042 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:36,042 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631416042 2023-04-04 17:53:36,044 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:53:36,045 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-04-04 17:53:36,045 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:36,046 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x021eb6f3 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:36,050 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@467efd62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:36,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:36,899 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e91df6a81dc9444290fdb617d3a01809 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103e91df6a81dc9444290fdb617d3a01809 2023-04-04 17:53:36,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:36,912 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:36,913 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:36,920 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:53:36,922 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:53:36,934 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 first=Optional[r5] last=Optional[r6] 2023-04-04 17:53:36,935 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68}] 2023-04-04 17:53:36,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 for inclusion in fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:36,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-04-04 17:53:36,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:36,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:36,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__evpcu4e8qjnih8ftv1a710a6v5pfmd8d37iqgqa9odqts7fdvhi5frt35mhop49a/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 2023-04-04 17:53:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__evpcu4e8qjnih8ftv1a710a6v5pfmd8d37iqgqa9odqts7fdvhi5frt35mhop49a/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_ 2023-04-04 17:53:36,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__evpcu4e8qjnih8ftv1a710a6v5pfmd8d37iqgqa9odqts7fdvhi5frt35mhop49a/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_ - updating store file list. 2023-04-04 17:53:36,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_ into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:36,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__evpcu4e8qjnih8ftv1a710a6v5pfmd8d37iqgqa9odqts7fdvhi5frt35mhop49a/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_) 2023-04-04 17:53:36,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__evpcu4e8qjnih8ftv1a710a6v5pfmd8d37iqgqa9odqts7fdvhi5frt35mhop49a/family1/93e9e36e1e3c45d2b0d0d7e5d2ae0f68 2023-04-04 17:53:36,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-04 17:53:36,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-04 17:53:36,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): fbcdf4e9a177d06d96f6c07ba7d9a211/family1 is initiating minor compaction 2023-04-04 17:53:36,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@10f94c90; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-04 17:53:36,955 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fbcdf4e9a177d06d96f6c07ba7d9a211/family1 in testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:36,956 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/a202aca01bee4505b933162a0b4db7ff, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/452f1b51452d4f61b397781dde2152d0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/261128670a214629930babbfde6cdfa5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/8b3aa6772ded41bca683d1cdff10ea6f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/3933159ee63648db9b1236f338f0fc3d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/da1102d249b6408e89c25102d3f13ffc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/680b8ab98f0f4705b2d8e561d0d286ec, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/e3bbc3e370264e8bae418e65abe2aec4, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/c77fc656de244af29332d8a12c17c235, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp, totalSize=49.7 K 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting a202aca01bee4505b933162a0b4db7ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 452f1b51452d4f61b397781dde2152d0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 261128670a214629930babbfde6cdfa5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 8b3aa6772ded41bca683d1cdff10ea6f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 3933159ee63648db9b1236f338f0fc3d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting da1102d249b6408e89c25102d3f13ffc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 680b8ab98f0f4705b2d8e561d0d286ec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-04 17:53:36,956 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting e3bbc3e370264e8bae418e65abe2aec4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-04 17:53:36,957 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting c77fc656de244af29332d8a12c17c235, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-04 17:53:36,957 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 9184553a6659481bacf79144978e26dc_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-04 17:53:36,958 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:36,959 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:36,961 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010186aa3ab2121c4817a309b41051499bed to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010186aa3ab2121c4817a309b41051499bed 2023-04-04 17:53:36,963 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103469ac665749549b6b8db4dd067e50b89 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103469ac665749549b6b8db4dd067e50b89 2023-04-04 17:53:36,963 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-04-04 17:53:36,963 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-04-04 17:53:36,963 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:36,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:37,004 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): fbcdf4e9a177d06d96f6c07ba7d9a211#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:53:37,832 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/5ca38247422f4c01a7e020ba3d6329a7 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/5ca38247422f4c01a7e020ba3d6329a7 2023-04-04 17:53:37,835 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231701a12affec94f0ab156b00d51304090 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231701a12affec94f0ab156b00d51304090 2023-04-04 17:53:37,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:37,839 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fbcdf4e9a177d06d96f6c07ba7d9a211/family1 of fbcdf4e9a177d06d96f6c07ba7d9a211 into 5ca38247422f4c01a7e020ba3d6329a7(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:53:37,839 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:37,840 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1680630816955; duration=0sec 2023-04-04 17:53:37,840 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:37,862 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/eac41fd8ae644d47b744646671814fe8 first=Optional[r1] last=Optional[r4] 2023-04-04 17:53:37,862 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/eac41fd8ae644d47b744646671814fe8}] 2023-04-04 17:53:37,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/eac41fd8ae644d47b744646671814fe8 for inclusion in fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-04-04 17:53:37,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:37,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:37,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/eac41fd8ae644d47b744646671814fe8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u0e1dp7dbpir16p1msg5tu9r3f7ikmjribef8i637rap0lfaa3csd5qv66drnpbc/family1/eac41fd8ae644d47b744646671814fe8 2023-04-04 17:53:37,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u0e1dp7dbpir16p1msg5tu9r3f7ikmjribef8i637rap0lfaa3csd5qv66drnpbc/family1/eac41fd8ae644d47b744646671814fe8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_ 2023-04-04 17:53:37,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u0e1dp7dbpir16p1msg5tu9r3f7ikmjribef8i637rap0lfaa3csd5qv66drnpbc/family1/eac41fd8ae644d47b744646671814fe8 into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_ - updating store file list. 2023-04-04 17:53:37,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/a202aca01bee4505b933162a0b4db7ff, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/452f1b51452d4f61b397781dde2152d0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/261128670a214629930babbfde6cdfa5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/8b3aa6772ded41bca683d1cdff10ea6f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/3933159ee63648db9b1236f338f0fc3d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/da1102d249b6408e89c25102d3f13ffc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/680b8ab98f0f4705b2d8e561d0d286ec, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/e3bbc3e370264e8bae418e65abe2aec4, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/c77fc656de244af29332d8a12c17c235, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_] to archive 2023-04-04 17:53:37,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:37,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/a202aca01bee4505b933162a0b4db7ff to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/a202aca01bee4505b933162a0b4db7ff 2023-04-04 17:53:37,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_ into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:37,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u0e1dp7dbpir16p1msg5tu9r3f7ikmjribef8i637rap0lfaa3csd5qv66drnpbc/family1/eac41fd8ae644d47b744646671814fe8 into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_) 2023-04-04 17:53:37,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/452f1b51452d4f61b397781dde2152d0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/452f1b51452d4f61b397781dde2152d0 2023-04-04 17:53:37,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u0e1dp7dbpir16p1msg5tu9r3f7ikmjribef8i637rap0lfaa3csd5qv66drnpbc/family1/eac41fd8ae644d47b744646671814fe8 2023-04-04 17:53:37,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:53:37,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/261128670a214629930babbfde6cdfa5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/261128670a214629930babbfde6cdfa5 2023-04-04 17:53:37,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:53:37,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): fbcdf4e9a177d06d96f6c07ba7d9a211/family1 is initiating minor compaction (all files) 2023-04-04 17:53:37,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5a3461c3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:37,889 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fbcdf4e9a177d06d96f6c07ba7d9a211/family1 in testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:53:37,889 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/b7eba0d72bff43789be4abc5150fbd65, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/5ca38247422f4c01a7e020ba3d6329a7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp, totalSize=178.1 K 2023-04-04 17:53:37,889 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting b7eba0d72bff43789be4abc5150fbd65, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809546 2023-04-04 17:53:37,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/8b3aa6772ded41bca683d1cdff10ea6f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/8b3aa6772ded41bca683d1cdff10ea6f 2023-04-04 17:53:37,890 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 5ca38247422f4c01a7e020ba3d6329a7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209546 2023-04-04 17:53:37,890 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965209546 2023-04-04 17:53:37,891 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:37,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/3933159ee63648db9b1236f338f0fc3d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/3933159ee63648db9b1236f338f0fc3d 2023-04-04 17:53:37,894 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:37,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/da1102d249b6408e89c25102d3f13ffc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/da1102d249b6408e89c25102d3f13ffc 2023-04-04 17:53:37,896 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201db45596540d44fe899203f7da54b1e18 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201db45596540d44fe899203f7da54b1e18 2023-04-04 17:53:37,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053ac7c5f0c62a4efcafa9cd45e8ea2323 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053ac7c5f0c62a4efcafa9cd45e8ea2323 2023-04-04 17:53:37,903 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228afc7621e241e4463942fc881db6e585b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228afc7621e241e4463942fc881db6e585b 2023-04-04 17:53:37,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fad1f371fced40aa8a76ed769011c0da to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fad1f371fced40aa8a76ed769011c0da 2023-04-04 17:53:37,905 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-04-04 17:53:37,905 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-04-04 17:53:37,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:37,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:37,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/680b8ab98f0f4705b2d8e561d0d286ec to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/680b8ab98f0f4705b2d8e561d0d286ec 2023-04-04 17:53:37,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/e3bbc3e370264e8bae418e65abe2aec4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/e3bbc3e370264e8bae418e65abe2aec4 2023-04-04 17:53:37,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/c77fc656de244af29332d8a12c17c235 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/c77fc656de244af29332d8a12c17c235 2023-04-04 17:53:37,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/9184553a6659481bacf79144978e26dc_SeqId_44_ 2023-04-04 17:53:37,929 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): fbcdf4e9a177d06d96f6c07ba7d9a211#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:53:38,761 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113052d50fd626cb4c11835f9ba6ef36d8e7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113052d50fd626cb4c11835f9ba6ef36d8e7 2023-04-04 17:53:38,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:38,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e41d6bff63da4f2c8f43e628709119cd first=Optional[r00] last=Optional[r8] 2023-04-04 17:53:38,788 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e41d6bff63da4f2c8f43e628709119cd}] 2023-04-04 17:53:38,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e41d6bff63da4f2c8f43e628709119cd for inclusion in fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:38,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-04-04 17:53:38,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:38,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:38,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e41d6bff63da4f2c8f43e628709119cd to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1cd4mijgbl6fuo04johu71t0o4f94vfpul4sefuk9mmagipoer2samm0rt9fovk3/family1/e41d6bff63da4f2c8f43e628709119cd 2023-04-04 17:53:38,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1cd4mijgbl6fuo04johu71t0o4f94vfpul4sefuk9mmagipoer2samm0rt9fovk3/family1/e41d6bff63da4f2c8f43e628709119cd as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/2ad0a13c2249463c9d477c4374b76234_SeqId_49_ 2023-04-04 17:53:38,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1cd4mijgbl6fuo04johu71t0o4f94vfpul4sefuk9mmagipoer2samm0rt9fovk3/family1/e41d6bff63da4f2c8f43e628709119cd into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/2ad0a13c2249463c9d477c4374b76234_SeqId_49_ - updating store file list. 2023-04-04 17:53:38,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/2ad0a13c2249463c9d477c4374b76234_SeqId_49_ into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 2023-04-04 17:53:38,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1cd4mijgbl6fuo04johu71t0o4f94vfpul4sefuk9mmagipoer2samm0rt9fovk3/family1/e41d6bff63da4f2c8f43e628709119cd into fbcdf4e9a177d06d96f6c07ba7d9a211/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/2ad0a13c2249463c9d477c4374b76234_SeqId_49_) 2023-04-04 17:53:38,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1cd4mijgbl6fuo04johu71t0o4f94vfpul4sefuk9mmagipoer2samm0rt9fovk3/family1/e41d6bff63da4f2c8f43e628709119cd 2023-04-04 17:53:38,807 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:38,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:38,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e0a6fb6216f5415495ebde968bf5f5ed to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e0a6fb6216f5415495ebde968bf5f5ed 2023-04-04 17:53:38,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112894f6c398a5964258919b82f6de216814 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112894f6c398a5964258919b82f6de216814 2023-04-04 17:53:38,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130680de2a8eeb04db4b0eadc1b0dfee14b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130680de2a8eeb04db4b0eadc1b0dfee14b 2023-04-04 17:53:38,812 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-04-04 17:53:38,812 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-04 17:53:38,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:38,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:38,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:53:38,813 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:53:38,813 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:38,814 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:53:38,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7760 sec 2023-04-04 17:53:38,937 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252 (was 248) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1595161031_15 at /127.0.0.1:50964 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x021eb6f3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51060 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fd07e10-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fd07e10-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51248 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fd07e10-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fd07e10-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51044 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fd07e10-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51140 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51154 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51242 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x021eb6f3-SendThread(127.0.0.1:61441) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51064 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61441@0x021eb6f3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1717549233.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/80aa7cb0c02b4150a17d7fbe3382eb76 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51176 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:50986 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fd07e10-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51138 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fd07e10-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51180 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51166 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_403281895_15 at /127.0.0.1:51020 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 591) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 302), ProcessCount=173 (was 173), AvailableMemoryMB=7749 (was 7802) 2023-04-04 17:53:38,950 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=173, AvailableMemoryMB=7747 2023-04-04 17:53:38,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-04 17:53:38,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:38,956 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:53:38,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-04-04 17:53:38,977 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:53:38,977 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3841bb2d to 127.0.0.1:61441 2023-04-04 17:53:38,977 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:53:38,977 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:53:38,979 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:53:38,979 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78ba07c3 to 127.0.0.1:61441 2023-04-04 17:53:38,979 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:53:38,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-04 17:53:38,979 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:53:38,981 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x021eb6f3 to 127.0.0.1:61441 2023-04-04 17:53:38,981 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:53:38,982 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:38,982 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897 empty. 2023-04-04 17:53:38,983 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:38,983 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-04-04 17:53:38,991 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:38,993 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => acf2d83bae94fd197a3d0b22ed9bf897, NAME => 'testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:39,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-04 17:53:39,158 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/.tmp/family1/80aa7cb0c02b4150a17d7fbe3382eb76 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/80aa7cb0c02b4150a17d7fbe3382eb76 2023-04-04 17:53:39,166 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fbcdf4e9a177d06d96f6c07ba7d9a211/family1 of fbcdf4e9a177d06d96f6c07ba7d9a211 into 80aa7cb0c02b4150a17d7fbe3382eb76(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:53:39,167 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:53:39,167 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1680630817888; duration=1sec 2023-04-04 17:53:39,167 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:39,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/b7eba0d72bff43789be4abc5150fbd65, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/5ca38247422f4c01a7e020ba3d6329a7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_] to archive 2023-04-04 17:53:39,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:39,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/b7eba0d72bff43789be4abc5150fbd65 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/b7eba0d72bff43789be4abc5150fbd65 2023-04-04 17:53:39,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/5ca38247422f4c01a7e020ba3d6329a7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/5ca38247422f4c01a7e020ba3d6329a7 2023-04-04 17:53:39,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/family1/4d978489ab6048e0a7fc2a3087a34a1c_SeqId_47_ 2023-04-04 17:53:39,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-04 17:53:39,402 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:39,402 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing acf2d83bae94fd197a3d0b22ed9bf897, disabling compactions & flushes 2023-04-04 17:53:39,402 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:39,402 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:39,402 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. after waiting 0 ms 2023-04-04 17:53:39,403 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:39,403 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:39,403 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:39,409 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:53:39,411 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680630819410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630819410"}]},"ts":"1680630819410"} 2023-04-04 17:53:39,414 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:53:39,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:53:39,416 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630819416"}]},"ts":"1680630819416"} 2023-04-04 17:53:39,418 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-04-04 17:53:39,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=acf2d83bae94fd197a3d0b22ed9bf897, ASSIGN}] 2023-04-04 17:53:39,424 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=acf2d83bae94fd197a3d0b22ed9bf897, ASSIGN 2023-04-04 17:53:39,425 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=acf2d83bae94fd197a3d0b22ed9bf897, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:39,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=acf2d83bae94fd197a3d0b22ed9bf897, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:39,577 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680630819576"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630819576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630819576"}]},"ts":"1680630819576"} 2023-04-04 17:53:39,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure acf2d83bae94fd197a3d0b22ed9bf897, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:39,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-04 17:53:39,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:39,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => acf2d83bae94fd197a3d0b22ed9bf897, NAME => 'testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:39,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:39,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:39,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:39,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:39,748 INFO [StoreOpener-acf2d83bae94fd197a3d0b22ed9bf897-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:39,751 DEBUG [StoreOpener-acf2d83bae94fd197a3d0b22ed9bf897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1 2023-04-04 17:53:39,751 DEBUG [StoreOpener-acf2d83bae94fd197a3d0b22ed9bf897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1 2023-04-04 17:53:39,752 INFO [StoreOpener-acf2d83bae94fd197a3d0b22ed9bf897-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acf2d83bae94fd197a3d0b22ed9bf897 columnFamilyName family1 2023-04-04 17:53:39,755 INFO [StoreOpener-acf2d83bae94fd197a3d0b22ed9bf897-1] regionserver.HStore(310): Store=acf2d83bae94fd197a3d0b22ed9bf897/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:39,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:39,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:39,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:53:39,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:39,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened acf2d83bae94fd197a3d0b22ed9bf897; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64060243, jitterRate=-0.045427992939949036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:53:39,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:39,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897., pid=25, masterSystemTime=1680630819736 2023-04-04 17:53:39,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:39,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:39,769 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=acf2d83bae94fd197a3d0b22ed9bf897, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:39,769 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680630819768"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630819768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630819768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630819768"}]},"ts":"1680630819768"} 2023-04-04 17:53:39,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-04-04 17:53:39,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure acf2d83bae94fd197a3d0b22ed9bf897, server=jenkins-hbase17.apache.org,46251,1680630785259 in 190 msec 2023-04-04 17:53:39,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-04-04 17:53:39,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=acf2d83bae94fd197a3d0b22ed9bf897, ASSIGN in 351 msec 2023-04-04 17:53:39,775 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:53:39,775 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630819775"}]},"ts":"1680630819775"} 2023-04-04 17:53:39,776 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-04-04 17:53:39,778 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:53:39,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 825 msec 2023-04-04 17:53:40,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-04 17:53:40,086 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-04-04 17:53:40,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:40,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,116 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:40,116 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:40,116 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:40,116 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:40,117 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,117 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,118 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,118 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:40,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:40,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:40,118 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,118 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:40,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:40,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,119 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,119 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:40,119 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:40,119 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:40,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:40,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:40,122 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:40,122 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:40,123 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-04 17:53:40,553 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306beb3252d1514685b6ac503be9bd6fe6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511306beb3252d1514685b6ac503be9bd6fe6 2023-04-04 17:53:40,959 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/f29d8ee30cc14f04939c5286c58f34a2 2023-04-04 17:53:40,973 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/f29d8ee30cc14f04939c5286c58f34a2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/f29d8ee30cc14f04939c5286c58f34a2 2023-04-04 17:53:40,980 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/f29d8ee30cc14f04939c5286c58f34a2, entries=1000, sequenceid=5, filesize=165.1 K 2023-04-04 17:53:40,981 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 859ms, sequenceid=5, compaction requested=false 2023-04-04 17:53:40,982 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:40,982 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:40,982 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:40,982 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:40,982 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:40,982 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,982 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:40,982 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:40,983 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,983 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:40,984 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,984 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@611136a7[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:40,985 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:40,985 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,986 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,986 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:40,986 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:40,986 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:40,986 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,987 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:40,987 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,987 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:40,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:40,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:40,987 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:40,988 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:40,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:40,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:40,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:40,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:40,990 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:40,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:40,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:40,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,990 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:40,991 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,991 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,991 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:40,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:40,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:40,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:40,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:40,992 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:40,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:40,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,995 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,995 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:40,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:40,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:40,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:40,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:40,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:40,996 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:41,097 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:41,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:41,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:41,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,104 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:41,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:41,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:41,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:41,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,105 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,105 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:41,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:41,105 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,106 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:41,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,107 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:41,107 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:41,107 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:41,107 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:41,107 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:41,107 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:41,107 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:41,107 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-04 17:53:41,529 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a46165a3cd404c7cb08ad61d607d5e7c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128a46165a3cd404c7cb08ad61d607d5e7c 2023-04-04 17:53:41,938 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/064a8af6e98646f79b3b6e99dac0539d 2023-04-04 17:53:41,949 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/064a8af6e98646f79b3b6e99dac0539d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/064a8af6e98646f79b3b6e99dac0539d 2023-04-04 17:53:41,955 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/064a8af6e98646f79b3b6e99dac0539d, entries=1, sequenceid=9, filesize=5.0 K 2023-04-04 17:53:41,956 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 849ms, sequenceid=9, compaction requested=false 2023-04-04 17:53:41,956 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:41,956 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:41,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:41,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:41,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:41,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:41,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,958 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:41,958 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,958 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:41,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:41,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44ba7df3[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:41,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:41,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:41,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:41,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:41,961 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,961 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:41,962 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:41,962 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:41,962 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:41,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:41,965 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:41,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:41,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:41,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,965 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:41,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:41,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,967 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:41,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:41,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,970 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:41,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:41,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:41,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:41,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:42,070 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:42,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:42,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:42,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:42,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,086 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:42,086 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:42,086 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:42,086 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:42,087 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,087 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,088 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:42,088 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:42,089 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,089 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,091 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,092 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:42,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,092 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:42,092 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:42,092 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:42,092 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:42,092 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:42,092 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:42,092 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:42,093 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:42,520 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012746b6ea715b423b886bfe649cc999be to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512012746b6ea715b423b886bfe649cc999be 2023-04-04 17:53:42,928 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/1923d16bfd384fb382345e46661a50df 2023-04-04 17:53:42,939 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/1923d16bfd384fb382345e46661a50df as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/1923d16bfd384fb382345e46661a50df 2023-04-04 17:53:42,946 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/1923d16bfd384fb382345e46661a50df, entries=1, sequenceid=13, filesize=4.9 K 2023-04-04 17:53:42,947 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 854ms, sequenceid=13, compaction requested=true 2023-04-04 17:53:42,948 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:42,949 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:42,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:42,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:42,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:42,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:42,951 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,951 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:42,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:42,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:42,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1111ab86[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:42,954 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:42,955 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,956 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:42,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:42,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:42,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:42,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,957 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:42,957 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:42,958 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:42,961 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:42,961 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:42,961 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:42,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:42,961 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,961 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:42,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:42,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:42,963 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,964 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:42,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:42,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:42,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:42,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:42,966 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:42,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:42,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:43,066 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:43,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:43,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:43,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:43,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,076 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:43,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:43,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:43,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:43,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,079 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:43,079 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:43,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:43,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:43,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,081 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,081 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:43,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:43,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:43,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:43,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:43,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:43,082 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:43,082 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:43,082 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:43,502 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050fa60072c60541c989e6dd0f96c1f831 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512050fa60072c60541c989e6dd0f96c1f831 2023-04-04 17:53:43,912 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/89ee7c062f134a18bbf9b5d83f932d74 2023-04-04 17:53:43,925 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/89ee7c062f134a18bbf9b5d83f932d74 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/89ee7c062f134a18bbf9b5d83f932d74 2023-04-04 17:53:43,932 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/89ee7c062f134a18bbf9b5d83f932d74, entries=1, sequenceid=17, filesize=4.9 K 2023-04-04 17:53:43,933 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 851ms, sequenceid=17, compaction requested=true 2023-04-04 17:53:43,933 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:43,933 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:43,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:43,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:43,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:43,933 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:43,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,934 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:43,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:43,935 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,935 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:43,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:43,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42df17c8[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:43,936 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:43,936 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,937 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,937 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:43,937 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:43,937 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:43,937 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,937 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:43,938 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,938 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:43,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:43,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:43,938 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:43,938 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:43,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:43,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:43,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:43,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:43,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:43,940 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:43,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:43,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:43,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,940 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:43,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:43,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:43,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:43,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:43,941 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:43,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:43,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:43,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,943 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:43,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:43,945 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:43,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:43,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:43,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:43,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:43,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,946 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:43,946 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:43,946 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:43,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:44,046 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:44,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:44,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:44,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:44,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,053 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:44,053 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:44,053 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:44,053 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:44,054 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,054 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,055 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:44,055 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:44,055 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,055 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:44,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,057 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,057 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:44,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,057 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:44,057 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:44,057 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:44,057 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:44,057 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:44,057 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:44,057 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:44,058 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:44,479 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228003d94cb3a5640efbac7d26b45429bf7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228003d94cb3a5640efbac7d26b45429bf7 2023-04-04 17:53:44,890 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/ab60d27a0a244c758de5e246437579a9 2023-04-04 17:53:44,905 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/ab60d27a0a244c758de5e246437579a9 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/ab60d27a0a244c758de5e246437579a9 2023-04-04 17:53:44,912 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/ab60d27a0a244c758de5e246437579a9, entries=1, sequenceid=21, filesize=4.9 K 2023-04-04 17:53:44,913 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 855ms, sequenceid=21, compaction requested=true 2023-04-04 17:53:44,913 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:44,914 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:44,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:44,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:44,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:44,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:44,915 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,915 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:44,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:44,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:44,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a13a53a[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:44,918 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:44,918 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,919 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:44,919 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:44,919 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:44,919 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,919 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:44,920 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:44,920 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,921 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,921 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:44,925 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:44,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:44,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:44,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,925 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:44,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,927 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:44,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:44,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:44,928 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:44,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,930 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:44,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:44,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:44,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:44,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:44,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:44,933 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:44,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:44,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:44,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,934 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:44,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:44,934 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:44,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:45,034 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:45,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:45,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:45,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,049 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:45,049 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:45,049 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:45,049 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:45,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,051 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:45,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:45,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:45,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:45,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,052 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,052 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:45,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,052 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:45,052 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:45,052 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:45,052 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:45,053 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:45,053 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:45,053 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:45,053 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:45,274 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:53:45,471 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123183fd9feb5d52438a90a75c0639fb7dd5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123183fd9feb5d52438a90a75c0639fb7dd5 2023-04-04 17:53:45,880 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/87e3ebb9492740418ecc9ed4327d8a73 2023-04-04 17:53:45,890 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/87e3ebb9492740418ecc9ed4327d8a73 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/87e3ebb9492740418ecc9ed4327d8a73 2023-04-04 17:53:45,897 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/87e3ebb9492740418ecc9ed4327d8a73, entries=1, sequenceid=25, filesize=4.9 K 2023-04-04 17:53:45,899 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 846ms, sequenceid=25, compaction requested=true 2023-04-04 17:53:45,899 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:45,899 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:45,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:45,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:45,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:45,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:45,901 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,901 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:45,901 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,901 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:45,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:45,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dd1006e[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:45,903 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:45,903 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,904 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:45,904 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:45,904 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,905 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:45,904 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:45,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,906 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:45,906 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,906 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:45,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:45,910 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:45,910 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:45,910 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:45,910 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,910 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:45,912 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,912 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:45,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,912 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:45,913 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,914 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,917 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:45,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:45,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:45,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:45,917 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:45,918 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:45,918 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:45,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:46,018 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:46,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:46,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:46,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:46,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,030 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:46,030 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:46,030 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:46,030 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:46,031 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,031 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,033 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:46,033 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:46,033 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,034 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,035 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,035 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:46,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,036 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:46,036 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:46,036 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:46,036 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:46,036 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:46,036 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:46,036 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:46,036 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:46,451 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012de752970feb47009eb823c0dfaec95a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012de752970feb47009eb823c0dfaec95a 2023-04-04 17:53:46,860 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/9fbce48058fd4ca8b7f1fdf589728771 2023-04-04 17:53:46,872 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/9fbce48058fd4ca8b7f1fdf589728771 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/9fbce48058fd4ca8b7f1fdf589728771 2023-04-04 17:53:46,880 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/9fbce48058fd4ca8b7f1fdf589728771, entries=1, sequenceid=29, filesize=4.9 K 2023-04-04 17:53:46,881 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 845ms, sequenceid=29, compaction requested=true 2023-04-04 17:53:46,881 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:46,881 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:46,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:46,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:46,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:46,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:46,883 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,883 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:46,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:46,883 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,883 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:46,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:46,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2180d1c9[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:46,886 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:46,886 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,887 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,887 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:46,887 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:46,887 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:46,887 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,887 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:46,888 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,888 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:46,888 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:46,888 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:46,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:46,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:46,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:46,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:46,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:46,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:46,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:46,893 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:46,893 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:46,893 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:46,893 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,893 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:46,895 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,895 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:46,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,895 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:46,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:46,896 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:46,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,898 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:46,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:46,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:46,901 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:46,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:46,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:46,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:46,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:46,901 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,901 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:46,901 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,901 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:46,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:46,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:46,901 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:46,902 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:46,901 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,002 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:47,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:47,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:47,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:47,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,012 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:47,012 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:47,012 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:47,013 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:47,013 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,013 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,014 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:47,014 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:47,015 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,015 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:47,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,018 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:47,018 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:47,018 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:47,018 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:47,018 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:47,018 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:47,018 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:47,019 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:47,444 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010311c8c601fd6f4b17bf396990553beb8d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010311c8c601fd6f4b17bf396990553beb8d 2023-04-04 17:53:47,853 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/598c34fdd014412e94094d0246469280 2023-04-04 17:53:47,865 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/598c34fdd014412e94094d0246469280 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/598c34fdd014412e94094d0246469280 2023-04-04 17:53:47,871 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/598c34fdd014412e94094d0246469280, entries=1, sequenceid=33, filesize=4.9 K 2023-04-04 17:53:47,872 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 853ms, sequenceid=33, compaction requested=true 2023-04-04 17:53:47,872 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:47,872 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:47,872 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:47,872 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:47,872 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,872 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:47,872 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:47,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,874 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:47,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:47,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:47,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bdbe366[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:47,876 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:47,876 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,877 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:47,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:47,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:47,877 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,877 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:47,878 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,878 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:47,878 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:47,878 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:47,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:47,881 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:47,881 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:47,881 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:47,881 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,881 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:47,883 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,883 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,883 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:47,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:47,884 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:47,885 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,888 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,888 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:47,888 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:47,888 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:47,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:47,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:47,888 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:47,888 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:47,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:47,889 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:47,889 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:47,889 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:47,889 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,889 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,889 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:47,989 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:47,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:48,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:48,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:48,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,006 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:48,006 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:48,006 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:48,006 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:48,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,008 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:48,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:48,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,009 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,010 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:48,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,010 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:48,010 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:48,010 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:48,010 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:48,010 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:48,010 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:48,010 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:48,010 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:48,432 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073ce10afc4302404c9009f158f42c60d9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509073ce10afc4302404c9009f158f42c60d9 2023-04-04 17:53:48,840 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/01072188aa6149c2b7629484827367d8 2023-04-04 17:53:48,853 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/01072188aa6149c2b7629484827367d8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/01072188aa6149c2b7629484827367d8 2023-04-04 17:53:48,860 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/01072188aa6149c2b7629484827367d8, entries=1, sequenceid=37, filesize=4.9 K 2023-04-04 17:53:48,861 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 851ms, sequenceid=37, compaction requested=true 2023-04-04 17:53:48,861 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:48,861 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:48,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:48,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:48,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:48,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:48,863 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:48,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:48,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:48,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:48,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:48,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cd6af52[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:48,865 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:48,865 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,865 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:48,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:48,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:48,866 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,866 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:48,866 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:48,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:48,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:48,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:48,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:48,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:48,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:48,868 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:48,868 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:48,868 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:48,868 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,868 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:48,869 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,869 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:48,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,869 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:48,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:48,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:48,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:48,870 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,870 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:48,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:48,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:48,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:48,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:48,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:48,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:48,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:48,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:48,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,972 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:48,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:48,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:48,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:48,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,985 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:48,985 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:48,985 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:48,985 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:48,986 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,986 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,988 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:48,988 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:48,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:48,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:48,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:48,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:48,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,990 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,990 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:53:48,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:48,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:48,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:48,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:48,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:48,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:48,991 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:48,991 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. started... 2023-04-04 17:53:48,991 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing acf2d83bae94fd197a3d0b22ed9bf897 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:53:49,413 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112001c05ba11010497b94569ba1dee6f837 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112001c05ba11010497b94569ba1dee6f837 2023-04-04 17:53:49,820 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/7ff3b04845a04538ab69e6faf11ced7d 2023-04-04 17:53:49,832 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/7ff3b04845a04538ab69e6faf11ced7d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/7ff3b04845a04538ab69e6faf11ced7d 2023-04-04 17:53:49,838 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/7ff3b04845a04538ab69e6faf11ced7d, entries=1, sequenceid=41, filesize=4.9 K 2023-04-04 17:53:49,839 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for acf2d83bae94fd197a3d0b22ed9bf897 in 848ms, sequenceid=41, compaction requested=true 2023-04-04 17:53:49,839 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:49,839 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:49,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:49,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:49,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:49,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:49,840 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,840 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:49,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:49,841 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,841 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:49,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:49,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:49,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:49,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:49,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19b108d6[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:49,842 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:49,842 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,843 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,843 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:49,843 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:49,843 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:49,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:49,844 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,844 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:49,844 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:49,844 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:49,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:49,846 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:49,846 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:49,846 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:49,846 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,846 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:49,847 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,847 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,847 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:49,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:49,847 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,848 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,850 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:49,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:49,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-04 17:53:49,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:49,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:49,850 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:49,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:49,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:49,951 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:49,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:49,956 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-04-04 17:53:49,960 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:53:49,961 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:53:49,962 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:49,962 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631429962 2023-04-04 17:53:49,968 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-04 17:53:49,969 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-04-04 17:53:49,969 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:53:49,970 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x4c970a4a to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:49,976 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30cbcd36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:49,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,820 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d183639d84724c2fbd5210c4f2f9d28b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103d183639d84724c2fbd5210c4f2f9d28b 2023-04-04 17:53:50,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:53:50,835 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:50,836 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:50,842 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:53:50,844 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:53:50,854 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dcfa681b25df4ae3996c2822bb26f028 first=Optional[r3] last=Optional[r6] 2023-04-04 17:53:50,855 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dcfa681b25df4ae3996c2822bb26f028}] 2023-04-04 17:53:50,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dcfa681b25df4ae3996c2822bb26f028 for inclusion in acf2d83bae94fd197a3d0b22ed9bf897/family1 2023-04-04 17:53:50,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-04 17:53:50,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:50,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:50,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dcfa681b25df4ae3996c2822bb26f028 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ul6r9pisihef20vqm257th51v9diuu2nvlt17brtucv7agkngrvpsd406kfnbkvo/family1/dcfa681b25df4ae3996c2822bb26f028 2023-04-04 17:53:50,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ul6r9pisihef20vqm257th51v9diuu2nvlt17brtucv7agkngrvpsd406kfnbkvo/family1/dcfa681b25df4ae3996c2822bb26f028 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_ 2023-04-04 17:53:50,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ul6r9pisihef20vqm257th51v9diuu2nvlt17brtucv7agkngrvpsd406kfnbkvo/family1/dcfa681b25df4ae3996c2822bb26f028 into acf2d83bae94fd197a3d0b22ed9bf897/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_ - updating store file list. 2023-04-04 17:53:50,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_ into acf2d83bae94fd197a3d0b22ed9bf897/family1 2023-04-04 17:53:50,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ul6r9pisihef20vqm257th51v9diuu2nvlt17brtucv7agkngrvpsd406kfnbkvo/family1/dcfa681b25df4ae3996c2822bb26f028 into acf2d83bae94fd197a3d0b22ed9bf897/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_) 2023-04-04 17:53:50,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ul6r9pisihef20vqm257th51v9diuu2nvlt17brtucv7agkngrvpsd406kfnbkvo/family1/dcfa681b25df4ae3996c2822bb26f028 2023-04-04 17:53:50,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-04 17:53:50,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-04 17:53:50,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): acf2d83bae94fd197a3d0b22ed9bf897/family1 is initiating minor compaction 2023-04-04 17:53:50,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@275cc377; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:50,877 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of acf2d83bae94fd197a3d0b22ed9bf897/family1 in testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:50,877 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/064a8af6e98646f79b3b6e99dac0539d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/1923d16bfd384fb382345e46661a50df, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/89ee7c062f134a18bbf9b5d83f932d74, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/ab60d27a0a244c758de5e246437579a9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/87e3ebb9492740418ecc9ed4327d8a73, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/9fbce48058fd4ca8b7f1fdf589728771, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/598c34fdd014412e94094d0246469280, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/01072188aa6149c2b7629484827367d8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/7ff3b04845a04538ab69e6faf11ced7d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp, totalSize=50.0 K 2023-04-04 17:53:50,877 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 064a8af6e98646f79b3b6e99dac0539d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:53:50,877 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 1923d16bfd384fb382345e46661a50df, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:53:50,877 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 89ee7c062f134a18bbf9b5d83f932d74, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-04 17:53:50,877 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting ab60d27a0a244c758de5e246437579a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-04 17:53:50,877 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 87e3ebb9492740418ecc9ed4327d8a73, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-04 17:53:50,878 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 9fbce48058fd4ca8b7f1fdf589728771, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-04 17:53:50,878 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 598c34fdd014412e94094d0246469280, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-04 17:53:50,878 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 01072188aa6149c2b7629484827367d8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-04 17:53:50,878 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 7ff3b04845a04538ab69e6faf11ced7d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-04 17:53:50,878 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 67f239463615410088b0a5d9f65a81da_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-04 17:53:50,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:53:50,879 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:50,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228003d94cb3a5640efbac7d26b45429bf7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228003d94cb3a5640efbac7d26b45429bf7 2023-04-04 17:53:50,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123183fd9feb5d52438a90a75c0639fb7dd5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123183fd9feb5d52438a90a75c0639fb7dd5 2023-04-04 17:53:50,883 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012de752970feb47009eb823c0dfaec95a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012de752970feb47009eb823c0dfaec95a 2023-04-04 17:53:50,884 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010311c8c601fd6f4b17bf396990553beb8d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010311c8c601fd6f4b17bf396990553beb8d 2023-04-04 17:53:50,884 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-04-04 17:53:50,884 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-04 17:53:50,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:50,915 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): acf2d83bae94fd197a3d0b22ed9bf897#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:53:51,340 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/dcc94893b4104a21814651452b137f0c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/dcc94893b4104a21814651452b137f0c 2023-04-04 17:53:51,346 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in acf2d83bae94fd197a3d0b22ed9bf897/family1 of acf2d83bae94fd197a3d0b22ed9bf897 into dcc94893b4104a21814651452b137f0c(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:53:51,346 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:51,346 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1680630830876; duration=0sec 2023-04-04 17:53:51,346 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:51,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/064a8af6e98646f79b3b6e99dac0539d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/1923d16bfd384fb382345e46661a50df, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/89ee7c062f134a18bbf9b5d83f932d74, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/ab60d27a0a244c758de5e246437579a9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/87e3ebb9492740418ecc9ed4327d8a73, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/9fbce48058fd4ca8b7f1fdf589728771, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/598c34fdd014412e94094d0246469280, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/01072188aa6149c2b7629484827367d8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/7ff3b04845a04538ab69e6faf11ced7d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_] to archive 2023-04-04 17:53:51,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:51,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/064a8af6e98646f79b3b6e99dac0539d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/064a8af6e98646f79b3b6e99dac0539d 2023-04-04 17:53:51,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/1923d16bfd384fb382345e46661a50df to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/1923d16bfd384fb382345e46661a50df 2023-04-04 17:53:51,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/89ee7c062f134a18bbf9b5d83f932d74 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/89ee7c062f134a18bbf9b5d83f932d74 2023-04-04 17:53:51,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/ab60d27a0a244c758de5e246437579a9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/ab60d27a0a244c758de5e246437579a9 2023-04-04 17:53:51,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/87e3ebb9492740418ecc9ed4327d8a73 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/87e3ebb9492740418ecc9ed4327d8a73 2023-04-04 17:53:51,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/9fbce48058fd4ca8b7f1fdf589728771 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/9fbce48058fd4ca8b7f1fdf589728771 2023-04-04 17:53:51,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/598c34fdd014412e94094d0246469280 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/598c34fdd014412e94094d0246469280 2023-04-04 17:53:51,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/01072188aa6149c2b7629484827367d8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/01072188aa6149c2b7629484827367d8 2023-04-04 17:53:51,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/7ff3b04845a04538ab69e6faf11ced7d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/7ff3b04845a04538ab69e6faf11ced7d 2023-04-04 17:53:51,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/67f239463615410088b0a5d9f65a81da_SeqId_44_ 2023-04-04 17:53:51,749 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a22e086e101740759fa0be859924e0f8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a22e086e101740759fa0be859924e0f8 2023-04-04 17:53:51,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:53:51,774 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c first=Optional[r1] last=Optional[r2] 2023-04-04 17:53:51,775 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c}] 2023-04-04 17:53:51,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c for inclusion in acf2d83bae94fd197a3d0b22ed9bf897/family1 2023-04-04 17:53:51,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-04-04 17:53:51,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:53:51,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:51,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__sgobk9let0edo9f55p1g67k1uinqmcaqogvlg8pohgvfbq10s7fea1di3783eimb/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c 2023-04-04 17:53:51,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__sgobk9let0edo9f55p1g67k1uinqmcaqogvlg8pohgvfbq10s7fea1di3783eimb/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_ 2023-04-04 17:53:51,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__sgobk9let0edo9f55p1g67k1uinqmcaqogvlg8pohgvfbq10s7fea1di3783eimb/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c into acf2d83bae94fd197a3d0b22ed9bf897/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_ - updating store file list. 2023-04-04 17:53:51,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_ into acf2d83bae94fd197a3d0b22ed9bf897/family1 2023-04-04 17:53:51,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__sgobk9let0edo9f55p1g67k1uinqmcaqogvlg8pohgvfbq10s7fea1di3783eimb/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c into acf2d83bae94fd197a3d0b22ed9bf897/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_) 2023-04-04 17:53:51,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithWeeklyPolicy__sgobk9let0edo9f55p1g67k1uinqmcaqogvlg8pohgvfbq10s7fea1di3783eimb/family1/45c0d4ecc7a6472aa5a0c1fe5226ec4c 2023-04-04 17:53:51,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:53:51,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:53:51,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): acf2d83bae94fd197a3d0b22ed9bf897/family1 is initiating minor compaction (all files) 2023-04-04 17:53:51,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@68db5ff8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:51,796 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of acf2d83bae94fd197a3d0b22ed9bf897/family1 in testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:53:51,797 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/f29d8ee30cc14f04939c5286c58f34a2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/dcc94893b4104a21814651452b137f0c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp, totalSize=176.8 K 2023-04-04 17:53:51,797 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting f29d8ee30cc14f04939c5286c58f34a2, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809546 2023-04-04 17:53:51,797 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting dcc94893b4104a21814651452b137f0c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209546 2023-04-04 17:53:51,798 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting a3f15433faa3454694df9aa16038afe7_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965209546 2023-04-04 17:53:51,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:53:51,800 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:51,802 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512012746b6ea715b423b886bfe649cc999be to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512012746b6ea715b423b886bfe649cc999be 2023-04-04 17:53:51,803 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512050fa60072c60541c989e6dd0f96c1f831 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512050fa60072c60541c989e6dd0f96c1f831 2023-04-04 17:53:51,803 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-04-04 17:53:51,803 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-04 17:53:51,804 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:53:51,804 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:53:51,804 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:51,805 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:53:51,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8480 sec 2023-04-04 17:53:51,815 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): acf2d83bae94fd197a3d0b22ed9bf897#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:53:51,900 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=251 (was 252), OpenFileDescriptor=589 (was 601), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 250), ProcessCount=173 (was 173), AvailableMemoryMB=7719 (was 7747) 2023-04-04 17:53:51,911 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=173, AvailableMemoryMB=7718 2023-04-04 17:53:51,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-04 17:53:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:51,917 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:53:51,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-04-04 17:53:51,918 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:53:51,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-04 17:53:51,920 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:51,921 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:51,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:51,921 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7 empty. 2023-04-04 17:53:51,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb empty. 2023-04-04 17:53:51,921 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4 empty. 2023-04-04 17:53:51,922 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:51,922 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:51,922 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:51,922 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-04-04 17:53:52,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-04 17:53:52,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-04 17:53:52,335 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:52,338 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 22f8a664f9eb3d423eec415bf13577f7, NAME => 'testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:52,340 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 97ce33ec5c1b7d56a02087d1c4da7fa4, NAME => 'testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:52,340 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => c13d58559c17e839b9a2079352ce59cb, NAME => 'testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:52,351 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:52,351 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 22f8a664f9eb3d423eec415bf13577f7, disabling compactions & flushes 2023-04-04 17:53:52,351 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:52,351 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:52,351 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. after waiting 0 ms 2023-04-04 17:53:52,351 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:52,351 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:52,351 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 22f8a664f9eb3d423eec415bf13577f7: 2023-04-04 17:53:52,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-04 17:53:52,753 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:52,753 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 97ce33ec5c1b7d56a02087d1c4da7fa4, disabling compactions & flushes 2023-04-04 17:53:52,753 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:52,754 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:52,754 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. after waiting 0 ms 2023-04-04 17:53:52,754 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:52,754 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:52,754 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 97ce33ec5c1b7d56a02087d1c4da7fa4: 2023-04-04 17:53:52,754 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:52,754 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing c13d58559c17e839b9a2079352ce59cb, disabling compactions & flushes 2023-04-04 17:53:52,755 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:52,755 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:52,755 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. after waiting 0 ms 2023-04-04 17:53:52,755 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:52,755 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:52,755 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for c13d58559c17e839b9a2079352ce59cb: 2023-04-04 17:53:52,761 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:53:52,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680630832762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630832762"}]},"ts":"1680630832762"} 2023-04-04 17:53:52,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680630832762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630832762"}]},"ts":"1680630832762"} 2023-04-04 17:53:52,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680630832762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630832762"}]},"ts":"1680630832762"} 2023-04-04 17:53:52,765 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-04 17:53:52,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:53:52,766 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630832765"}]},"ts":"1680630832765"} 2023-04-04 17:53:52,767 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-04-04 17:53:52,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=22f8a664f9eb3d423eec415bf13577f7, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=97ce33ec5c1b7d56a02087d1c4da7fa4, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c13d58559c17e839b9a2079352ce59cb, ASSIGN}] 2023-04-04 17:53:52,771 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c13d58559c17e839b9a2079352ce59cb, ASSIGN 2023-04-04 17:53:52,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=97ce33ec5c1b7d56a02087d1c4da7fa4, ASSIGN 2023-04-04 17:53:52,771 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=22f8a664f9eb3d423eec415bf13577f7, ASSIGN 2023-04-04 17:53:52,771 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c13d58559c17e839b9a2079352ce59cb, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:52,771 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=97ce33ec5c1b7d56a02087d1c4da7fa4, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:52,771 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=22f8a664f9eb3d423eec415bf13577f7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:52,925 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=c13d58559c17e839b9a2079352ce59cb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:52,925 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=97ce33ec5c1b7d56a02087d1c4da7fa4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:52,925 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=22f8a664f9eb3d423eec415bf13577f7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:52,926 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680630832925"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630832925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630832925"}]},"ts":"1680630832925"} 2023-04-04 17:53:52,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680630832925"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630832925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630832925"}]},"ts":"1680630832925"} 2023-04-04 17:53:52,926 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680630832925"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630832925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630832925"}]},"ts":"1680630832925"} 2023-04-04 17:53:52,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure c13d58559c17e839b9a2079352ce59cb, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:52,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 22f8a664f9eb3d423eec415bf13577f7, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:52,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 97ce33ec5c1b7d56a02087d1c4da7fa4, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:53,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-04 17:53:53,041 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/.tmp/family1/7233e288eda243f7a04471d9cb7bf5e1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/7233e288eda243f7a04471d9cb7bf5e1 2023-04-04 17:53:53,048 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in acf2d83bae94fd197a3d0b22ed9bf897/family1 of acf2d83bae94fd197a3d0b22ed9bf897 into 7233e288eda243f7a04471d9cb7bf5e1(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:53:53,048 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:53:53,048 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1680630831796; duration=1sec 2023-04-04 17:53:53,048 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:53,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/f29d8ee30cc14f04939c5286c58f34a2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/dcc94893b4104a21814651452b137f0c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_] to archive 2023-04-04 17:53:53,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:53,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/f29d8ee30cc14f04939c5286c58f34a2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/f29d8ee30cc14f04939c5286c58f34a2 2023-04-04 17:53:53,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:53,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22f8a664f9eb3d423eec415bf13577f7, NAME => 'testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7.', STARTKEY => '', ENDKEY => '1'} 2023-04-04 17:53:53,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:53,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/dcc94893b4104a21814651452b137f0c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/dcc94893b4104a21814651452b137f0c 2023-04-04 17:53:53,088 INFO [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/family1/a3f15433faa3454694df9aa16038afe7_SeqId_47_ 2023-04-04 17:53:53,089 DEBUG [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7/family1 2023-04-04 17:53:53,089 DEBUG [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7/family1 2023-04-04 17:53:53,090 INFO [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22f8a664f9eb3d423eec415bf13577f7 columnFamilyName family1 2023-04-04 17:53:53,091 INFO [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] regionserver.HStore(310): Store=22f8a664f9eb3d423eec415bf13577f7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:53,092 INFO [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,093 DEBUG [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7/family2 2023-04-04 17:53:53,093 DEBUG [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7/family2 2023-04-04 17:53:53,093 INFO [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22f8a664f9eb3d423eec415bf13577f7 columnFamilyName family2 2023-04-04 17:53:53,095 INFO [StoreOpener-22f8a664f9eb3d423eec415bf13577f7-1] regionserver.HStore(310): Store=22f8a664f9eb3d423eec415bf13577f7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:53,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:53:53,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:53:53,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:53,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 22f8a664f9eb3d423eec415bf13577f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67895921, jitterRate=0.011728063225746155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:53:53,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 22f8a664f9eb3d423eec415bf13577f7: 2023-04-04 17:53:53,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7., pid=32, masterSystemTime=1680630833082 2023-04-04 17:53:53,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:53,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:53,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:53,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 97ce33ec5c1b7d56a02087d1c4da7fa4, NAME => 'testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4.', STARTKEY => '1', ENDKEY => '2'} 2023-04-04 17:53:53,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:53,106 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=22f8a664f9eb3d423eec415bf13577f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:53,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,106 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680630833106"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630833106"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630833106"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630833106"}]},"ts":"1680630833106"} 2023-04-04 17:53:53,108 INFO [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,109 DEBUG [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4/family1 2023-04-04 17:53:53,109 DEBUG [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4/family1 2023-04-04 17:53:53,110 INFO [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97ce33ec5c1b7d56a02087d1c4da7fa4 columnFamilyName family1 2023-04-04 17:53:53,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-04-04 17:53:53,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 22f8a664f9eb3d423eec415bf13577f7, server=jenkins-hbase17.apache.org,46251,1680630785259 in 178 msec 2023-04-04 17:53:53,111 INFO [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] regionserver.HStore(310): Store=97ce33ec5c1b7d56a02087d1c4da7fa4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:53,111 INFO [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=22f8a664f9eb3d423eec415bf13577f7, ASSIGN in 342 msec 2023-04-04 17:53:53,113 DEBUG [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4/family2 2023-04-04 17:53:53,113 DEBUG [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4/family2 2023-04-04 17:53:53,114 INFO [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97ce33ec5c1b7d56a02087d1c4da7fa4 columnFamilyName family2 2023-04-04 17:53:53,115 INFO [StoreOpener-97ce33ec5c1b7d56a02087d1c4da7fa4-1] regionserver.HStore(310): Store=97ce33ec5c1b7d56a02087d1c4da7fa4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:53,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:53:53,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:53:53,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:53,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 97ce33ec5c1b7d56a02087d1c4da7fa4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64091386, jitterRate=-0.04496392607688904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:53:53,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 97ce33ec5c1b7d56a02087d1c4da7fa4: 2023-04-04 17:53:53,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4., pid=33, masterSystemTime=1680630833082 2023-04-04 17:53:53,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:53,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:53,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:53,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c13d58559c17e839b9a2079352ce59cb, NAME => 'testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb.', STARTKEY => '2', ENDKEY => ''} 2023-04-04 17:53:53,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:53,124 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=97ce33ec5c1b7d56a02087d1c4da7fa4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:53,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,124 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680630833124"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630833124"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630833124"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630833124"}]},"ts":"1680630833124"} 2023-04-04 17:53:53,125 INFO [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,127 DEBUG [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1 2023-04-04 17:53:53,127 DEBUG [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1 2023-04-04 17:53:53,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-04-04 17:53:53,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 97ce33ec5c1b7d56a02087d1c4da7fa4, server=jenkins-hbase17.apache.org,46251,1680630785259 in 194 msec 2023-04-04 17:53:53,127 INFO [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c13d58559c17e839b9a2079352ce59cb columnFamilyName family1 2023-04-04 17:53:53,129 INFO [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] regionserver.HStore(310): Store=c13d58559c17e839b9a2079352ce59cb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:53,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=97ce33ec5c1b7d56a02087d1c4da7fa4, ASSIGN in 358 msec 2023-04-04 17:53:53,129 INFO [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,130 DEBUG [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family2 2023-04-04 17:53:53,131 DEBUG [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family2 2023-04-04 17:53:53,131 INFO [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c13d58559c17e839b9a2079352ce59cb columnFamilyName family2 2023-04-04 17:53:53,132 INFO [StoreOpener-c13d58559c17e839b9a2079352ce59cb-1] regionserver.HStore(310): Store=c13d58559c17e839b9a2079352ce59cb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:53,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:53:53,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:53:53,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:53,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c13d58559c17e839b9a2079352ce59cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70230802, jitterRate=0.046520501375198364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:53:53,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c13d58559c17e839b9a2079352ce59cb: 2023-04-04 17:53:53,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb., pid=31, masterSystemTime=1680630833082 2023-04-04 17:53:53,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:53,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:53,141 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=c13d58559c17e839b9a2079352ce59cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:53,142 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680630833141"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630833141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630833141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630833141"}]},"ts":"1680630833141"} 2023-04-04 17:53:53,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-04-04 17:53:53,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure c13d58559c17e839b9a2079352ce59cb, server=jenkins-hbase17.apache.org,46251,1680630785259 in 214 msec 2023-04-04 17:53:53,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=27 2023-04-04 17:53:53,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c13d58559c17e839b9a2079352ce59cb, ASSIGN in 375 msec 2023-04-04 17:53:53,147 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:53:53,147 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630833147"}]},"ts":"1680630833147"} 2023-04-04 17:53:53,148 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-04-04 17:53:53,150 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:53:53,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2360 sec 2023-04-04 17:53:54,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-04 17:53:54,027 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-04-04 17:53:54,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:54,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,047 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-04-04 17:53:54,047 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:54,047 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-04-04 17:53:54,047 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-04-04 17:53:54,048 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,048 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,049 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:54,049 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:54,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:54,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:54,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:54,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,052 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,052 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-04-04 17:53:54,052 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:54,052 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-04-04 17:53:54,053 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:54,053 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. started... 2023-04-04 17:53:54,053 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:54,054 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:54,053 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:53:54,054 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:54,054 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. started... 2023-04-04 17:53:54,054 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 22f8a664f9eb3d423eec415bf13577f7: 2023-04-04 17:53:54,054 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. started... 2023-04-04 17:53:54,055 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:54,055 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 97ce33ec5c1b7d56a02087d1c4da7fa4: 2023-04-04 17:53:54,056 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:53:54,056 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c13d58559c17e839b9a2079352ce59cb 2/2 column families, dataSize=48 B heapSize=632 B 2023-04-04 17:53:54,056 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:54,056 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:53:54,478 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304049191dbff486645d8a910c460e722d4ca to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202304049191dbff486645d8a910c460e722d4ca 2023-04-04 17:53:54,560 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-04-04 17:53:54,886 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/.tmp/family1/2d2ac370d5314b4d812dea3ac72995d7 2023-04-04 17:53:54,897 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/.tmp/family1/2d2ac370d5314b4d812dea3ac72995d7 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/2d2ac370d5314b4d812dea3ac72995d7 2023-04-04 17:53:54,904 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/2d2ac370d5314b4d812dea3ac72995d7, entries=1, sequenceid=5, filesize=4.9 K 2023-04-04 17:53:54,906 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for c13d58559c17e839b9a2079352ce59cb in 849ms, sequenceid=5, compaction requested=false 2023-04-04 17:53:54,906 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c13d58559c17e839b9a2079352ce59cb: 2023-04-04 17:53:54,906 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:54,906 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:53:54,907 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:53:54,907 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,907 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-04-04 17:53:54,907 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-04-04 17:53:54,908 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,908 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:54,909 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,909 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-04-04 17:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e988cb0[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:54,911 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-04-04 17:53:54,911 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,912 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-04-04 17:53:54,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-04-04 17:53:54,912 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,912 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:54,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:54,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-04-04 17:53:54,914 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:54,914 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-04-04 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-04-04 17:53:54,917 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-04-04 17:53:54,917 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:54,917 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:54,917 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,917 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:54,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:54,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:54,920 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,921 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:54,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:54,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:54,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:54,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:54,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-04-04 17:53:54,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-04-04 17:53:54,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:54,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:54,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:54,926 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:54,926 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:55,027 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:55,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:55,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:55,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-04-04 17:53:55,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,042 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-04-04 17:53:55,042 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:55,042 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-04-04 17:53:55,042 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-04-04 17:53:55,043 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,043 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,044 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,044 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:55,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:55,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:55,045 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,045 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:55,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:55,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,046 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-04-04 17:53:55,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,047 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-04-04 17:53:55,047 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:55,047 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-04-04 17:53:55,047 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:55,047 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:55,047 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. started... 2023-04-04 17:53:55,047 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:53:55,048 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c13d58559c17e839b9a2079352ce59cb 2/2 column families, dataSize=90 B heapSize=752 B 2023-04-04 17:53:55,047 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. started... 2023-04-04 17:53:55,048 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:55,047 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:55,048 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 22f8a664f9eb3d423eec415bf13577f7: 2023-04-04 17:53:55,048 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. started... 2023-04-04 17:53:55,048 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:53:55,048 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 97ce33ec5c1b7d56a02087d1c4da7fa4: 2023-04-04 17:53:55,048 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:53:55,048 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:53:55,049 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:53:55,465 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404e437bd12546e47efaa2a64e84076c630 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230404e437bd12546e47efaa2a64e84076c630 2023-04-04 17:53:55,872 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/.tmp/family1/6d9fce6d071241a696d08f335e2ab511 2023-04-04 17:53:55,882 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/.tmp/family1/6d9fce6d071241a696d08f335e2ab511 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/6d9fce6d071241a696d08f335e2ab511 2023-04-04 17:53:55,888 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/6d9fce6d071241a696d08f335e2ab511, entries=2, sequenceid=9, filesize=5.0 K 2023-04-04 17:53:55,889 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for c13d58559c17e839b9a2079352ce59cb in 841ms, sequenceid=9, compaction requested=false 2023-04-04 17:53:55,889 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c13d58559c17e839b9a2079352ce59cb: 2023-04-04 17:53:55,889 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:55,889 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:53:55,890 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:53:55,890 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,890 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-04-04 17:53:55,890 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-04-04 17:53:55,891 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,891 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:55,891 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:55,892 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-04-04 17:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a9c88d6[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:55,893 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-04-04 17:53:55,893 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,894 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,894 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-04-04 17:53:55,894 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-04-04 17:53:55,894 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,894 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:55,894 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:55,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-04-04 17:53:55,895 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:55,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-04-04 17:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:55,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:55,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-04-04 17:53:55,898 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-04-04 17:53:55,899 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:55,899 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:55,899 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,899 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:55,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:55,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,902 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-04-04 17:53:55,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:55,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:55,904 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:55,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:55,905 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:55,905 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:55,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-04-04 17:53:55,905 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:55,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:55,905 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:55,905 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:55,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:55,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:56,005 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:53:56,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:53:56,022 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-04-04 17:53:56,024 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-04-04 17:53:56,025 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-04-04 17:53:56,025 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:56,026 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631436025 2023-04-04 17:53:56,026 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:53:56,026 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-04-04 17:53:56,027 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-04 17:53:56,027 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x4793b4ee to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:53:56,030 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29df6357, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:53:56,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230404 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-04-04 17:53:56,863 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304046500a9e7ac5b4802b41119a68d363d58 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202304046500a9e7ac5b4802b41119a68d363d58 2023-04-04 17:53:56,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-04 17:53:56,876 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:53:56,878 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:53:56,884 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:53:56,886 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:53:56,897 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ecbb6fc4cfd149d5b936348673fb8460 first=Optional[k0] last=Optional[k1] 2023-04-04 17:53:56,898 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ecbb6fc4cfd149d5b936348673fb8460}] 2023-04-04 17:53:56,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ecbb6fc4cfd149d5b936348673fb8460 for inclusion in c13d58559c17e839b9a2079352ce59cb/family1 2023-04-04 17:53:56,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-04-04 17:53:56,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-04 17:53:56,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for c13d58559c17e839b9a2079352ce59cb: 2023-04-04 17:53:56,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ecbb6fc4cfd149d5b936348673fb8460 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testScannerOnBulkLoadRefHFiles__e3e5rpciuvochp0nbdvfdft7obai3p0i5cv4nme18gm31bvt12l979dvqf8q7mbg/family1/ecbb6fc4cfd149d5b936348673fb8460 2023-04-04 17:53:56,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testScannerOnBulkLoadRefHFiles__e3e5rpciuvochp0nbdvfdft7obai3p0i5cv4nme18gm31bvt12l979dvqf8q7mbg/family1/ecbb6fc4cfd149d5b936348673fb8460 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_ 2023-04-04 17:53:56,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testScannerOnBulkLoadRefHFiles__e3e5rpciuvochp0nbdvfdft7obai3p0i5cv4nme18gm31bvt12l979dvqf8q7mbg/family1/ecbb6fc4cfd149d5b936348673fb8460 into c13d58559c17e839b9a2079352ce59cb/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_ - updating store file list. 2023-04-04 17:53:56,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_ into c13d58559c17e839b9a2079352ce59cb/family1 2023-04-04 17:53:56,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testScannerOnBulkLoadRefHFiles__e3e5rpciuvochp0nbdvfdft7obai3p0i5cv4nme18gm31bvt12l979dvqf8q7mbg/family1/ecbb6fc4cfd149d5b936348673fb8460 into c13d58559c17e839b9a2079352ce59cb/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_) 2023-04-04 17:53:56,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testScannerOnBulkLoadRefHFiles__e3e5rpciuvochp0nbdvfdft7obai3p0i5cv4nme18gm31bvt12l979dvqf8q7mbg/family1/ecbb6fc4cfd149d5b936348673fb8460 2023-04-04 17:53:56,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:53:56,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:53:56,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): c13d58559c17e839b9a2079352ce59cb/family1 is initiating minor compaction (all files) 2023-04-04 17:53:56,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6afe1602; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:56,916 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c13d58559c17e839b9a2079352ce59cb/family1 in testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:53:56,916 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/2d2ac370d5314b4d812dea3ac72995d7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/6d9fce6d071241a696d08f335e2ab511, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/.tmp, totalSize=15.1 K 2023-04-04 17:53:56,917 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 2d2ac370d5314b4d812dea3ac72995d7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630834027 2023-04-04 17:53:56,917 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 6d9fce6d071241a696d08f335e2ab511, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630834027 2023-04-04 17:53:56,918 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 26ca481465a84f038a46818c863316fb_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630834027 2023-04-04 17:53:56,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-04 17:53:56,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:56,921 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202304049191dbff486645d8a910c460e722d4ca to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202304049191dbff486645d8a910c460e722d4ca 2023-04-04 17:53:56,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230404e437bd12546e47efaa2a64e84076c630 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230404e437bd12546e47efaa2a64e84076c630 2023-04-04 17:53:56,923 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-04-04 17:53:56,923 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230404' 2023-04-04 17:53:56,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230404 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-04-04 17:53:56,923 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-04 17:53:56,923 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:53:56,925 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-04-04 17:53:56,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 901 msec 2023-04-04 17:53:56,932 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): c13d58559c17e839b9a2079352ce59cb#family1#compaction#38 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:53:56,962 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248 (was 251), OpenFileDescriptor=594 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 220) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=7714 (was 7718) 2023-04-04 17:53:56,975 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=248, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=173, AvailableMemoryMB=7714 2023-04-04 17:53:56,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-04 17:53:56,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:56,980 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:53:56,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-04-04 17:53:56,981 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:53:56,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-04 17:53:56,983 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:56,983 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3 empty. 2023-04-04 17:53:56,984 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:56,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-04-04 17:53:57,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-04 17:53:57,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-04 17:53:57,397 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-04 17:53:57,401 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1d0e62f7175836cd0cc3cd697b73c3d3, NAME => 'testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:53:57,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-04 17:53:57,813 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:57,813 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 1d0e62f7175836cd0cc3cd697b73c3d3, disabling compactions & flushes 2023-04-04 17:53:57,813 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:57,813 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:57,813 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. after waiting 0 ms 2023-04-04 17:53:57,813 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:57,814 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:57,814 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:53:57,820 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:53:57,822 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680630837822"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630837822"}]},"ts":"1680630837822"} 2023-04-04 17:53:57,824 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:53:57,825 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:53:57,825 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630837825"}]},"ts":"1680630837825"} 2023-04-04 17:53:57,826 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-04-04 17:53:57,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1d0e62f7175836cd0cc3cd697b73c3d3, ASSIGN}] 2023-04-04 17:53:57,831 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1d0e62f7175836cd0cc3cd697b73c3d3, ASSIGN 2023-04-04 17:53:57,832 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1d0e62f7175836cd0cc3cd697b73c3d3, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:53:57,984 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1d0e62f7175836cd0cc3cd697b73c3d3, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:57,985 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680630837984"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630837984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630837984"}]},"ts":"1680630837984"} 2023-04-04 17:53:57,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 1d0e62f7175836cd0cc3cd697b73c3d3, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:53:58,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-04 17:53:58,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:58,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1d0e62f7175836cd0cc3cd697b73c3d3, NAME => 'testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:53:58,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:58,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:53:58,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:58,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:58,150 INFO [StoreOpener-1d0e62f7175836cd0cc3cd697b73c3d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:58,152 DEBUG [StoreOpener-1d0e62f7175836cd0cc3cd697b73c3d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1 2023-04-04 17:53:58,152 DEBUG [StoreOpener-1d0e62f7175836cd0cc3cd697b73c3d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1 2023-04-04 17:53:58,152 INFO [StoreOpener-1d0e62f7175836cd0cc3cd697b73c3d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d0e62f7175836cd0cc3cd697b73c3d3 columnFamilyName family1 2023-04-04 17:53:58,154 INFO [StoreOpener-1d0e62f7175836cd0cc3cd697b73c3d3-1] regionserver.HStore(310): Store=1d0e62f7175836cd0cc3cd697b73c3d3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:53:58,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:58,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:58,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:53:58,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:53:58,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1d0e62f7175836cd0cc3cd697b73c3d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66123881, jitterRate=-0.014677390456199646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:53:58,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:53:58,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3., pid=37, masterSystemTime=1680630838144 2023-04-04 17:53:58,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:58,165 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/.tmp/family1/7779f70318e94b3e97ee3bef2b694c6c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/7779f70318e94b3e97ee3bef2b694c6c 2023-04-04 17:53:58,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:58,166 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1d0e62f7175836cd0cc3cd697b73c3d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:58,166 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680630838166"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630838166"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630838166"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630838166"}]},"ts":"1680630838166"} 2023-04-04 17:53:58,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-04-04 17:53:58,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 1d0e62f7175836cd0cc3cd697b73c3d3, server=jenkins-hbase17.apache.org,46251,1680630785259 in 179 msec 2023-04-04 17:53:58,171 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c13d58559c17e839b9a2079352ce59cb/family1 of c13d58559c17e839b9a2079352ce59cb into 7779f70318e94b3e97ee3bef2b694c6c(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:53:58,172 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c13d58559c17e839b9a2079352ce59cb: 2023-04-04 17:53:58,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-04-04 17:53:58,172 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1680630836916; duration=1sec 2023-04-04 17:53:58,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1d0e62f7175836cd0cc3cd697b73c3d3, ASSIGN in 340 msec 2023-04-04 17:53:58,172 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:53:58,172 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:53:58,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630838173"}]},"ts":"1680630838173"} 2023-04-04 17:53:58,174 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-04-04 17:53:58,176 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:53:58,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1980 sec 2023-04-04 17:53:58,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/2d2ac370d5314b4d812dea3ac72995d7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/6d9fce6d071241a696d08f335e2ab511, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_] to archive 2023-04-04 17:53:58,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:53:58,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/2d2ac370d5314b4d812dea3ac72995d7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/2d2ac370d5314b4d812dea3ac72995d7 2023-04-04 17:53:58,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/6d9fce6d071241a696d08f335e2ab511 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/6d9fce6d071241a696d08f335e2ab511 2023-04-04 17:53:58,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/family1/26ca481465a84f038a46818c863316fb_SeqId_12_ 2023-04-04 17:53:58,619 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:53:59,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-04 17:53:59,093 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-04-04 17:53:59,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:53:59,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,120 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:53:59,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:59,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:53:59,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:53:59,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,121 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:59,121 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:59,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:59,121 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,122 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:53:59,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:53:59,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,122 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:53:59,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:53:59,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:53:59,123 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:53:59,123 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:53:59,123 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:59,123 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:53:59,123 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-04 17:53:59,550 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308921f9e7edeb42c3b208518e42926f5f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308921f9e7edeb42c3b208518e42926f5f 2023-04-04 17:53:59,957 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/f3b6c5fa01d6482cadba03b9a89be35d 2023-04-04 17:53:59,970 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/f3b6c5fa01d6482cadba03b9a89be35d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/f3b6c5fa01d6482cadba03b9a89be35d 2023-04-04 17:53:59,978 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/f3b6c5fa01d6482cadba03b9a89be35d, entries=1000, sequenceid=5, filesize=165.1 K 2023-04-04 17:53:59,979 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 856ms, sequenceid=5, compaction requested=false 2023-04-04 17:53:59,979 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:53:59,980 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:53:59,980 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:53:59,980 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:53:59,980 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:53:59,980 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,980 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:53:59,980 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:53:59,981 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,981 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:59,982 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,982 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:53:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:59,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:59,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:59,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:53:59,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63a914e8[Count = 0] remaining members to acquire global barrier 2023-04-04 17:53:59,985 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:53:59,985 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,985 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,986 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:53:59,986 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:53:59,986 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:53:59,986 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,986 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:53:59,987 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:53:59,987 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,987 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:59,987 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:53:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:53:59,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:53:59,990 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:53:59,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:53:59,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:53:59,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,990 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:53:59,991 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,991 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,991 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:53:59,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:53:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,992 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:53:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:53:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:53:59,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:53:59,994 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:53:59,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:53:59,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:53:59,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:53:59,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:53:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:53:59,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:53:59,995 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,995 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,995 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:53:59,995 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:53:59,995 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:53:59,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:53:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:00,095 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:00,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:00,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:00,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,105 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:00,105 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:00,105 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:00,105 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:00,106 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,106 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,107 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:00,107 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:00,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:00,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:00,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:00,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,110 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,110 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:00,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,110 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:00,110 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:00,110 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:00,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:00,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:00,111 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:00,111 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:00,111 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-04 17:54:00,530 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e67881afcc294004b636188042ace9a8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128e67881afcc294004b636188042ace9a8 2023-04-04 17:54:00,940 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/72f5c9ccf0c14636a0f10830e16a5a1b 2023-04-04 17:54:00,952 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/72f5c9ccf0c14636a0f10830e16a5a1b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/72f5c9ccf0c14636a0f10830e16a5a1b 2023-04-04 17:54:00,958 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/72f5c9ccf0c14636a0f10830e16a5a1b, entries=1, sequenceid=9, filesize=5.0 K 2023-04-04 17:54:00,959 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 848ms, sequenceid=9, compaction requested=false 2023-04-04 17:54:00,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:00,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:00,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:00,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:00,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:00,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:00,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:00,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:00,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:00,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@724f47f3[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:00,963 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:00,963 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,964 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,965 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:00,965 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:00,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:00,965 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:00,966 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,966 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:00,966 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:00,966 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:00,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:00,968 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:00,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:00,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:00,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,968 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:00,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:00,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:00,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:00,971 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,972 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:00,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:00,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,974 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:00,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:54:00,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:00,974 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:00,975 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:00,975 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:01,075 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:01,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:01,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:01,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:01,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,090 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:01,090 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:01,090 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:01,090 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:01,091 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,091 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,092 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:01,092 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:01,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:01,093 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,093 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:01,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:01,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,095 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,095 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:01,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:01,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:01,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:01,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:01,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:01,095 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:01,095 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:01,096 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:01,517 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d13e167f38a64f10acd7ff2066d24b4c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d13e167f38a64f10acd7ff2066d24b4c 2023-04-04 17:54:01,926 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/a7d9f1a3218c4ec8822739c363b02c2b 2023-04-04 17:54:01,934 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/a7d9f1a3218c4ec8822739c363b02c2b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a7d9f1a3218c4ec8822739c363b02c2b 2023-04-04 17:54:01,942 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a7d9f1a3218c4ec8822739c363b02c2b, entries=1, sequenceid=13, filesize=4.9 K 2023-04-04 17:54:01,943 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 847ms, sequenceid=13, compaction requested=true 2023-04-04 17:54:01,943 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:01,944 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:01,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:01,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:01,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:01,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:01,946 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,946 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:01,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:01,946 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,946 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:01,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:01,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:01,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:01,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:01,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8c8a806[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:01,949 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:01,949 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,950 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:01,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:01,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:01,950 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,950 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:01,951 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:01,951 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:01,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:01,951 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:01,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:01,955 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:01,955 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:01,955 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:01,955 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,955 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:01,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:01,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:01,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:01,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:01,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:01,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:01,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:01,964 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:01,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:01,964 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:01,964 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:01,964 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:01,964 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:01,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:54:01,964 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:01,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:02,064 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:02,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:02,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:02,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:02,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,081 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:02,082 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:02,082 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:02,082 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:02,083 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,083 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,084 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:02,084 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:02,085 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,085 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,088 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:02,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,088 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:02,088 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:02,088 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:02,089 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:02,089 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:02,089 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:02,089 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:02,089 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:02,515 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055c47ecc4368c4e3aafc567d49813bae4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055c47ecc4368c4e3aafc567d49813bae4 2023-04-04 17:54:02,923 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/6ac08b23e55647938d14760169659653 2023-04-04 17:54:02,935 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/6ac08b23e55647938d14760169659653 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/6ac08b23e55647938d14760169659653 2023-04-04 17:54:02,943 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/6ac08b23e55647938d14760169659653, entries=1, sequenceid=17, filesize=4.9 K 2023-04-04 17:54:02,944 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 855ms, sequenceid=17, compaction requested=true 2023-04-04 17:54:02,944 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:02,944 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:02,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:02,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:02,944 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,945 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:02,945 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:02,946 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,946 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:02,947 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,947 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@168c5bf1[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:02,948 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:02,948 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,949 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:02,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:02,949 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,949 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:02,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:02,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:02,950 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:02,950 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:02,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:02,953 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:02,953 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:02,953 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:02,953 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,953 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:02,954 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,954 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,954 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:02,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:02,954 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:02,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:02,957 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:02,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:02,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:02,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:02,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:02,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:02,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:02,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,058 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:03,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:03,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:03,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:03,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,073 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:03,074 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:03,074 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:03,074 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:03,074 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,074 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,076 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:03,076 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:03,076 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,076 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,077 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,077 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:03,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:03,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:03,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:03,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:03,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:03,078 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:03,078 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:03,078 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:03,498 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ebe8c7a05b55459badef44c2ab1e4c7b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228ebe8c7a05b55459badef44c2ab1e4c7b 2023-04-04 17:54:03,653 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:54:03,907 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/26bc03fd8e1044a397ff744c01ecb26f 2023-04-04 17:54:03,920 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/26bc03fd8e1044a397ff744c01ecb26f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/26bc03fd8e1044a397ff744c01ecb26f 2023-04-04 17:54:03,925 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/26bc03fd8e1044a397ff744c01ecb26f, entries=1, sequenceid=21, filesize=4.9 K 2023-04-04 17:54:03,926 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 848ms, sequenceid=21, compaction requested=true 2023-04-04 17:54:03,926 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:03,926 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:03,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:03,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:03,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:03,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:03,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d29039c[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:03,929 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:03,930 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,930 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,930 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:03,930 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:03,930 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:03,930 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,930 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:03,931 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,931 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:03,931 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:03,931 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:03,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:03,933 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:03,933 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:03,933 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:03,933 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,933 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:03,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:03,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:03,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:03,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,936 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,937 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,937 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,937 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,937 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:03,938 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:03,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:03,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:03,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:03,938 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:03,938 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,938 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:03,938 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,938 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:03,938 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:03,938 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:03,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:54:03,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:04,038 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:04,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:04,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,051 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:04,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:04,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:04,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:04,052 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,053 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,054 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:04,054 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:04,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:04,055 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,055 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:04,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,057 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,058 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:04,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,058 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:04,058 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:04,058 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:04,058 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:04,059 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:04,059 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:04,059 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:04,059 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:04,479 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ccbe74b48c454e0eba1bb286a4f94c40 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccbe74b48c454e0eba1bb286a4f94c40 2023-04-04 17:54:04,890 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/db92550965cb4ebea17f42f0ae81e541 2023-04-04 17:54:04,902 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/db92550965cb4ebea17f42f0ae81e541 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/db92550965cb4ebea17f42f0ae81e541 2023-04-04 17:54:04,909 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/db92550965cb4ebea17f42f0ae81e541, entries=1, sequenceid=25, filesize=4.9 K 2023-04-04 17:54:04,910 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 851ms, sequenceid=25, compaction requested=true 2023-04-04 17:54:04,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:04,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:04,912 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:04,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:04,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:04,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35d1bb15[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:04,915 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:04,915 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,916 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:04,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:04,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:04,916 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,916 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:04,918 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:04,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:04,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:04,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:04,921 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:04,921 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:04,921 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:04,921 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,921 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:04,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:04,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:04,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:04,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:04,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:04,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:04,928 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:04,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,929 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:04,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:04,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:04,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:04,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:04,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:04,929 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:04,930 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:05,030 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:05,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:05,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:05,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:05,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,036 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:05,036 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:05,037 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:05,037 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:05,037 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,037 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,038 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,038 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:05,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:05,038 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,039 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,040 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:05,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:05,040 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:05,040 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:05,040 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:05,461 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c9197589784d4b408781834d01facc84 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101c9197589784d4b408781834d01facc84 2023-04-04 17:54:05,869 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/401d8d3821164dad95d764971aeac609 2023-04-04 17:54:05,881 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/401d8d3821164dad95d764971aeac609 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/401d8d3821164dad95d764971aeac609 2023-04-04 17:54:05,888 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/401d8d3821164dad95d764971aeac609, entries=1, sequenceid=29, filesize=4.9 K 2023-04-04 17:54:05,889 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 849ms, sequenceid=29, compaction requested=true 2023-04-04 17:54:05,889 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:05,889 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:05,889 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:05,889 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:05,889 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,889 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:05,890 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:05,891 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,891 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:05,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:05,892 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,892 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:05,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:05,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:05,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:05,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:05,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7894ad31[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:05,894 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:05,894 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,895 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:05,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:05,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:05,895 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,895 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:05,896 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,896 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:05,896 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:05,896 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:05,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:05,898 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:05,898 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:05,899 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:05,899 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,899 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:05,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:05,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,900 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:05,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:05,900 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:05,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:05,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:05,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:05,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:54:05,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:05,904 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:05,904 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:05,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:05,905 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,905 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:05,905 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,005 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:06,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:06,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:06,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:06,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,018 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:06,018 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:06,018 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:06,018 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:06,019 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,019 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,020 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:06,020 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:06,021 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,021 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,023 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,023 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:06,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:06,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:06,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:06,024 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:06,024 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:06,024 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:06,024 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:06,024 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:06,448 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b9ec217670974ebf9f04988a79441606 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103b9ec217670974ebf9f04988a79441606 2023-04-04 17:54:06,855 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/2c41123438b2468c95a821425dad98a2 2023-04-04 17:54:06,863 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/2c41123438b2468c95a821425dad98a2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/2c41123438b2468c95a821425dad98a2 2023-04-04 17:54:06,872 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/2c41123438b2468c95a821425dad98a2, entries=1, sequenceid=33, filesize=4.9 K 2023-04-04 17:54:06,874 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 850ms, sequenceid=33, compaction requested=true 2023-04-04 17:54:06,874 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:06,874 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:06,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:06,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:06,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:06,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:06,876 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,876 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:06,876 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,876 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:06,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:06,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cb33201[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:06,878 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:06,878 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,879 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:06,879 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:06,879 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:06,879 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,880 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:06,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:06,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:06,881 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:06,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:06,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:06,884 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:06,884 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:06,884 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:06,884 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,884 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:06,886 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,886 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,886 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:06,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:06,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:06,887 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:06,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:06,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,890 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,892 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,892 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:06,892 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,892 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:06,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-04 17:54:06,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:06,892 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:06,892 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:06,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:06,892 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:06,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:06,892 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,893 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,893 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:06,893 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:06,893 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:06,993 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:07,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:07,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:07,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,007 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:07,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:07,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:07,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:07,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,007 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,008 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:07,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:07,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,008 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,009 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,009 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:07,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:07,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:07,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:07,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:07,009 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:07,010 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:07,010 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:07,010 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:07,430 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090756a195a6ccc24fa69c08c7485fbcea6b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090756a195a6ccc24fa69c08c7485fbcea6b 2023-04-04 17:54:07,838 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/83dd39fabb83435791587ac0ff78ad5b 2023-04-04 17:54:07,851 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/83dd39fabb83435791587ac0ff78ad5b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/83dd39fabb83435791587ac0ff78ad5b 2023-04-04 17:54:07,860 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/83dd39fabb83435791587ac0ff78ad5b, entries=1, sequenceid=37, filesize=4.9 K 2023-04-04 17:54:07,861 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 851ms, sequenceid=37, compaction requested=true 2023-04-04 17:54:07,861 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:07,861 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:07,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:07,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:07,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:07,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:07,863 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:07,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7973f5e8[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:07,865 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:07,866 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,866 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,867 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:07,867 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:07,867 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:07,867 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,867 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:07,868 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,868 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:07,868 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:07,868 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:07,872 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:07,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:07,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:07,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,872 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:07,874 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,874 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:07,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,874 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:07,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:07,875 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,876 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:07,879 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:07,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,880 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,880 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:07,880 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:07,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:07,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:07,980 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:07,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:07,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:07,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:07,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,993 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:07,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:07,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-04 17:54:07,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-04 17:54:07,994 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,994 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,995 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,995 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:07,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:07,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:07,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,998 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,998 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-04 17:54:07,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:07,998 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-04 17:54:07,998 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:07,998 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-04 17:54:07,999 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:07,999 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:07,999 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:07,999 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. started... 2023-04-04 17:54:07,999 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d0e62f7175836cd0cc3cd697b73c3d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:08,426 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120975ee7d47e3349b28ae9198837a57e72 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120975ee7d47e3349b28ae9198837a57e72 2023-04-04 17:54:08,836 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/1969da560c72497394ff926ecdb6b360 2023-04-04 17:54:08,848 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/1969da560c72497394ff926ecdb6b360 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/1969da560c72497394ff926ecdb6b360 2023-04-04 17:54:08,857 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/1969da560c72497394ff926ecdb6b360, entries=1, sequenceid=41, filesize=4.9 K 2023-04-04 17:54:08,858 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1d0e62f7175836cd0cc3cd697b73c3d3 in 859ms, sequenceid=41, compaction requested=true 2023-04-04 17:54:08,858 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:08,858 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:08,858 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:08,858 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:08,858 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,858 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-04 17:54:08,858 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-04 17:54:08,860 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,860 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:08,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,861 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:08,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:08,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-04 17:54:08,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41c2e0c0[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:08,863 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-04 17:54:08,863 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,864 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-04 17:54:08,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-04 17:54:08,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:08,865 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,865 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:08,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-04 17:54:08,866 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:08,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:08,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:08,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-04 17:54:08,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:08,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:54:08,870 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-04 17:54:08,870 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:08,870 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:08,870 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,870 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:08,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:08,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:08,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:08,873 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,875 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:08,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-04 17:54:08,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:08,879 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:08,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:08,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,880 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:08,880 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:08,880 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:08,980 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:08,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:08,982 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-04-04 17:54:08,984 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:54:08,985 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:54:08,986 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:08,986 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631448986 2023-04-04 17:54:08,987 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:54:08,988 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-04-04 17:54:08,988 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:54:08,989 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x64a50e31 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:08,995 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36320c29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:08,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,855 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010321983308ed1a42d79b0859f99ae33811 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010321983308ed1a42d79b0859f99ae33811 2023-04-04 17:54:09,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:54:09,877 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:54:09,878 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:54:09,884 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:54:09,885 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:54:09,894 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ef037c8e12e4d5c86395b6f061ae19b first=Optional[r3] last=Optional[r6] 2023-04-04 17:54:09,895 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ef037c8e12e4d5c86395b6f061ae19b}] 2023-04-04 17:54:09,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ef037c8e12e4d5c86395b6f061ae19b for inclusion in 1d0e62f7175836cd0cc3cd697b73c3d3/family1 2023-04-04 17:54:09,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-04 17:54:09,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:09,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:09,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0ef037c8e12e4d5c86395b6f061ae19b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6vq55oltclh05kf6kfdfm48nks05f3gsk0bqdj2vsklg1josr192idu0cf5sk60j/family1/0ef037c8e12e4d5c86395b6f061ae19b 2023-04-04 17:54:09,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6vq55oltclh05kf6kfdfm48nks05f3gsk0bqdj2vsklg1josr192idu0cf5sk60j/family1/0ef037c8e12e4d5c86395b6f061ae19b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_ 2023-04-04 17:54:09,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6vq55oltclh05kf6kfdfm48nks05f3gsk0bqdj2vsklg1josr192idu0cf5sk60j/family1/0ef037c8e12e4d5c86395b6f061ae19b into 1d0e62f7175836cd0cc3cd697b73c3d3/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_ - updating store file list. 2023-04-04 17:54:09,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_ into 1d0e62f7175836cd0cc3cd697b73c3d3/family1 2023-04-04 17:54:09,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6vq55oltclh05kf6kfdfm48nks05f3gsk0bqdj2vsklg1josr192idu0cf5sk60j/family1/0ef037c8e12e4d5c86395b6f061ae19b into 1d0e62f7175836cd0cc3cd697b73c3d3/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_) 2023-04-04 17:54:09,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6vq55oltclh05kf6kfdfm48nks05f3gsk0bqdj2vsklg1josr192idu0cf5sk60j/family1/0ef037c8e12e4d5c86395b6f061ae19b 2023-04-04 17:54:09,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-04 17:54:09,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-04 17:54:09,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): 1d0e62f7175836cd0cc3cd697b73c3d3/family1 is initiating minor compaction 2023-04-04 17:54:09,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@65038007; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:09,919 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1d0e62f7175836cd0cc3cd697b73c3d3/family1 in testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:09,920 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/72f5c9ccf0c14636a0f10830e16a5a1b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a7d9f1a3218c4ec8822739c363b02c2b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/6ac08b23e55647938d14760169659653, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/26bc03fd8e1044a397ff744c01ecb26f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/db92550965cb4ebea17f42f0ae81e541, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/401d8d3821164dad95d764971aeac609, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/2c41123438b2468c95a821425dad98a2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/83dd39fabb83435791587ac0ff78ad5b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/1969da560c72497394ff926ecdb6b360, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp, totalSize=50.0 K 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 72f5c9ccf0c14636a0f10830e16a5a1b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting a7d9f1a3218c4ec8822739c363b02c2b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 6ac08b23e55647938d14760169659653, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 26bc03fd8e1044a397ff744c01ecb26f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting db92550965cb4ebea17f42f0ae81e541, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 401d8d3821164dad95d764971aeac609, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 2c41123438b2468c95a821425dad98a2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 83dd39fabb83435791587ac0ff78ad5b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 1969da560c72497394ff926ecdb6b360, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-04 17:54:09,920 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting faa563de421e4e15a65119e90d324220_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-04 17:54:09,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:54:09,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:09,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228ebe8c7a05b55459badef44c2ab1e4c7b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228ebe8c7a05b55459badef44c2ab1e4c7b 2023-04-04 17:54:09,925 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccbe74b48c454e0eba1bb286a4f94c40 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccbe74b48c454e0eba1bb286a4f94c40 2023-04-04 17:54:09,942 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:09,942 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c970a4a to 127.0.0.1:61441 2023-04-04 17:54:09,942 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:09,942 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:09,942 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4793b4ee to 127.0.0.1:61441 2023-04-04 17:54:09,942 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:09,943 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101c9197589784d4b408781834d01facc84 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101c9197589784d4b408781834d01facc84 2023-04-04 17:54:09,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103b9ec217670974ebf9f04988a79441606 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103b9ec217670974ebf9f04988a79441606 2023-04-04 17:54:09,944 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-04-04 17:54:09,944 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:09,971 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1d0e62f7175836cd0cc3cd697b73c3d3#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-04 17:54:10,790 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/006f2f16bf1b45c3930383fb61487d7e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/006f2f16bf1b45c3930383fb61487d7e 2023-04-04 17:54:10,799 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1d0e62f7175836cd0cc3cd697b73c3d3/family1 of 1d0e62f7175836cd0cc3cd697b73c3d3 into 006f2f16bf1b45c3930383fb61487d7e(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:54:10,799 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:10,800 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1680630849919; duration=0sec 2023-04-04 17:54:10,800 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:10,804 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120553726cf11c6b43f5b8db0f28c660446b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120553726cf11c6b43f5b8db0f28c660446b 2023-04-04 17:54:10,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:54:10,828 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/893f8d72c7d24b06b5a9b0613687c836 first=Optional[r00] last=Optional[r2] 2023-04-04 17:54:10,829 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/893f8d72c7d24b06b5a9b0613687c836}] 2023-04-04 17:54:10,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/893f8d72c7d24b06b5a9b0613687c836 for inclusion in 1d0e62f7175836cd0cc3cd697b73c3d3/family1 2023-04-04 17:54:10,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-04 17:54:10,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:10,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:10,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/893f8d72c7d24b06b5a9b0613687c836 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1rfv8o5mcf0qa68mdlbg8l1q5942q3nceepv3abpfqss6od6m932mmfb6sqd60fg/family1/893f8d72c7d24b06b5a9b0613687c836 2023-04-04 17:54:10,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1rfv8o5mcf0qa68mdlbg8l1q5942q3nceepv3abpfqss6od6m932mmfb6sqd60fg/family1/893f8d72c7d24b06b5a9b0613687c836 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_ 2023-04-04 17:54:10,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1rfv8o5mcf0qa68mdlbg8l1q5942q3nceepv3abpfqss6od6m932mmfb6sqd60fg/family1/893f8d72c7d24b06b5a9b0613687c836 into 1d0e62f7175836cd0cc3cd697b73c3d3/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_ - updating store file list. 2023-04-04 17:54:10,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_ into 1d0e62f7175836cd0cc3cd697b73c3d3/family1 2023-04-04 17:54:10,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1rfv8o5mcf0qa68mdlbg8l1q5942q3nceepv3abpfqss6od6m932mmfb6sqd60fg/family1/893f8d72c7d24b06b5a9b0613687c836 into 1d0e62f7175836cd0cc3cd697b73c3d3/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_) 2023-04-04 17:54:10,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1rfv8o5mcf0qa68mdlbg8l1q5942q3nceepv3abpfqss6od6m932mmfb6sqd60fg/family1/893f8d72c7d24b06b5a9b0613687c836 2023-04-04 17:54:10,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:54:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:54:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): 1d0e62f7175836cd0cc3cd697b73c3d3/family1 is initiating minor compaction (all files) 2023-04-04 17:54:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5cb1b1f7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:10,842 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1d0e62f7175836cd0cc3cd697b73c3d3/family1 in testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:54:10,842 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/f3b6c5fa01d6482cadba03b9a89be35d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/006f2f16bf1b45c3930383fb61487d7e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp, totalSize=337.0 K 2023-04-04 17:54:10,843 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting f3b6c5fa01d6482cadba03b9a89be35d, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809546 2023-04-04 17:54:10,843 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 006f2f16bf1b45c3930383fb61487d7e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209546 2023-04-04 17:54:10,844 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting a3dc50f450e9489094c351076e3b4dab_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809546 2023-04-04 17:54:10,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:54:10,845 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:10,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308921f9e7edeb42c3b208518e42926f5f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308921f9e7edeb42c3b208518e42926f5f 2023-04-04 17:54:10,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d13e167f38a64f10acd7ff2066d24b4c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d13e167f38a64f10acd7ff2066d24b4c 2023-04-04 17:54:10,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055c47ecc4368c4e3aafc567d49813bae4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055c47ecc4368c4e3aafc567d49813bae4 2023-04-04 17:54:10,849 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-04-04 17:54:10,849 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-04 17:54:10,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-04 17:54:10,850 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-04 17:54:10,850 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:10,851 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:54:10,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8680 sec 2023-04-04 17:54:10,860 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1d0e62f7175836cd0cc3cd697b73c3d3#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-04 17:54:10,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/72f5c9ccf0c14636a0f10830e16a5a1b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a7d9f1a3218c4ec8822739c363b02c2b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/6ac08b23e55647938d14760169659653, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/26bc03fd8e1044a397ff744c01ecb26f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/db92550965cb4ebea17f42f0ae81e541, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/401d8d3821164dad95d764971aeac609, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/2c41123438b2468c95a821425dad98a2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/83dd39fabb83435791587ac0ff78ad5b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/1969da560c72497394ff926ecdb6b360, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_] to archive 2023-04-04 17:54:10,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:10,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/72f5c9ccf0c14636a0f10830e16a5a1b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/72f5c9ccf0c14636a0f10830e16a5a1b 2023-04-04 17:54:10,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a7d9f1a3218c4ec8822739c363b02c2b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a7d9f1a3218c4ec8822739c363b02c2b 2023-04-04 17:54:10,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/6ac08b23e55647938d14760169659653 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/6ac08b23e55647938d14760169659653 2023-04-04 17:54:10,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/26bc03fd8e1044a397ff744c01ecb26f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/26bc03fd8e1044a397ff744c01ecb26f 2023-04-04 17:54:10,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/db92550965cb4ebea17f42f0ae81e541 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/db92550965cb4ebea17f42f0ae81e541 2023-04-04 17:54:10,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/401d8d3821164dad95d764971aeac609 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/401d8d3821164dad95d764971aeac609 2023-04-04 17:54:10,898 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-04-04 17:54:10,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/2c41123438b2468c95a821425dad98a2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/2c41123438b2468c95a821425dad98a2 2023-04-04 17:54:10,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/83dd39fabb83435791587ac0ff78ad5b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/83dd39fabb83435791587ac0ff78ad5b 2023-04-04 17:54:10,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/1969da560c72497394ff926ecdb6b360 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/1969da560c72497394ff926ecdb6b360 2023-04-04 17:54:10,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/faa563de421e4e15a65119e90d324220_SeqId_44_ 2023-04-04 17:54:10,952 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=245 (was 248), OpenFileDescriptor=590 (was 594), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 225), ProcessCount=173 (was 173), AvailableMemoryMB=7663 (was 7714) 2023-04-04 17:54:10,962 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=245, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=173, AvailableMemoryMB=7661 2023-04-04 17:54:10,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-04 17:54:10,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:10,967 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:54:10,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-04-04 17:54:10,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:54:10,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-04 17:54:10,969 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:10,970 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab empty. 2023-04-04 17:54:10,970 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:10,970 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-04-04 17:54:11,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-04 17:54:11,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-04 17:54:11,381 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-04-04 17:54:11,384 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => fa30c35db7c8b3298d236a5ab793eaab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:54:11,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-04 17:54:11,794 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:11,794 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing fa30c35db7c8b3298d236a5ab793eaab, disabling compactions & flushes 2023-04-04 17:54:11,794 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:11,794 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:11,794 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. after waiting 0 ms 2023-04-04 17:54:11,794 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:11,794 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:11,794 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:11,797 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:54:11,798 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630851798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630851798"}]},"ts":"1680630851798"} 2023-04-04 17:54:11,800 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:54:11,801 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:54:11,801 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630851801"}]},"ts":"1680630851801"} 2023-04-04 17:54:11,802 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-04-04 17:54:11,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, ASSIGN}] 2023-04-04 17:54:11,806 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, ASSIGN 2023-04-04 17:54:11,807 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:54:11,959 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:11,959 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630851959"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630851959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630851959"}]},"ts":"1680630851959"} 2023-04-04 17:54:11,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:12,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-04 17:54:12,098 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/.tmp/family1/9bdd108b251842658bbc6bde345ae18e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/9bdd108b251842658bbc6bde345ae18e 2023-04-04 17:54:12,106 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1d0e62f7175836cd0cc3cd697b73c3d3/family1 of 1d0e62f7175836cd0cc3cd697b73c3d3 into 9bdd108b251842658bbc6bde345ae18e(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:54:12,107 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:54:12,107 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1680630850842; duration=1sec 2023-04-04 17:54:12,107 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:12,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:12,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa30c35db7c8b3298d236a5ab793eaab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:54:12,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:12,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:12,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:12,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:12,124 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:12,126 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:12,127 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:12,127 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa30c35db7c8b3298d236a5ab793eaab columnFamilyName family1 2023-04-04 17:54:12,129 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(310): Store=fa30c35db7c8b3298d236a5ab793eaab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:12,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:12,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:12,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:12,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:54:12,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fa30c35db7c8b3298d236a5ab793eaab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60175186, jitterRate=-0.10331985354423523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:54:12,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:12,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., pid=41, masterSystemTime=1680630852117 2023-04-04 17:54:12,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:12,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:12,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:12,142 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630852142"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630852142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630852142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630852142"}]},"ts":"1680630852142"} 2023-04-04 17:54:12,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-04-04 17:54:12,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259 in 181 msec 2023-04-04 17:54:12,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-04-04 17:54:12,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, ASSIGN in 340 msec 2023-04-04 17:54:12,147 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:54:12,147 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630852147"}]},"ts":"1680630852147"} 2023-04-04 17:54:12,148 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-04-04 17:54:12,150 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:54:12,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1850 sec 2023-04-04 17:54:12,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/f3b6c5fa01d6482cadba03b9a89be35d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/006f2f16bf1b45c3930383fb61487d7e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_] to archive 2023-04-04 17:54:12,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:12,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/f3b6c5fa01d6482cadba03b9a89be35d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/f3b6c5fa01d6482cadba03b9a89be35d 2023-04-04 17:54:12,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/006f2f16bf1b45c3930383fb61487d7e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/006f2f16bf1b45c3930383fb61487d7e 2023-04-04 17:54:12,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/family1/a3dc50f450e9489094c351076e3b4dab_SeqId_47_ 2023-04-04 17:54:12,563 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:13,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-04 17:54:13,078 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-04-04 17:54:13,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:13,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,108 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:13,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:13,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:13,108 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:13,109 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,109 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,110 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,110 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:13,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:13,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:13,110 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,110 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:13,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:13,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,111 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,111 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:13,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:13,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:13,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:13,111 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:13,111 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:13,111 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:13,112 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-04 17:54:13,534 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113013f390318883448c90ce060f5fa76736 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113013f390318883448c90ce060f5fa76736 2023-04-04 17:54:13,940 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/d5349175577a44f4b3ca49abbd17b4bb 2023-04-04 17:54:13,945 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/d5349175577a44f4b3ca49abbd17b4bb as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/d5349175577a44f4b3ca49abbd17b4bb 2023-04-04 17:54:13,950 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/d5349175577a44f4b3ca49abbd17b4bb, entries=1000, sequenceid=5, filesize=191.4 K 2023-04-04 17:54:13,951 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 839ms, sequenceid=5, compaction requested=false 2023-04-04 17:54:13,952 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:13,952 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:13,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:13,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:13,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:13,952 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:13,953 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:13,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:13,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:13,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:13,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:13,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:13,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:13,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c6220ec[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:13,954 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:13,954 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,955 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:13,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:13,955 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:13,955 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,955 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:13,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:13,956 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:13,956 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:13,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:13,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:13,958 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:13,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:13,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:13,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,958 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:13,959 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,959 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:13,959 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,959 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:13,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:13,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:13,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:13,962 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:13,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:13,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:13,962 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:13,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:13,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:14,062 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:14,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:14,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:14,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:14,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,076 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:14,076 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:14,076 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:14,076 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:14,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,078 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,078 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:14,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:14,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:14,078 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,078 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:14,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:14,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:14,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:14,082 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:14,082 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:14,082 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:14,082 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:14,082 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-04 17:54:14,502 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289546cb43014741849d2521ddde8a66eb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289546cb43014741849d2521ddde8a66eb 2023-04-04 17:54:14,910 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/022da837992f493da7bcceac8164347e 2023-04-04 17:54:14,924 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/022da837992f493da7bcceac8164347e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/022da837992f493da7bcceac8164347e 2023-04-04 17:54:14,929 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/022da837992f493da7bcceac8164347e, entries=1, sequenceid=9, filesize=5.0 K 2023-04-04 17:54:14,930 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 848ms, sequenceid=9, compaction requested=false 2023-04-04 17:54:14,930 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:14,930 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:14,930 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:14,930 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:14,930 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,931 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:14,931 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:14,932 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,932 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:14,932 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,932 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9542a5b[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:14,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:14,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,935 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,935 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:14,935 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:14,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,936 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:14,936 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:14,936 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:14,936 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,937 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:14,937 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:14,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:14,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:14,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:14,940 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:14,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:14,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:14,940 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,940 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:14,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,941 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:14,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:14,941 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,943 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:14,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:14,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:14,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:14,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:14,946 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:14,946 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:14,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:14,945 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:14,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,946 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:14,946 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,946 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,946 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:14,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:15,046 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:15,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:15,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:15,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:15,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,061 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:15,061 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:15,061 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:15,061 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:15,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,063 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:15,063 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:15,064 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,064 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:15,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,065 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,065 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:15,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,066 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:15,066 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:15,066 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:15,066 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:15,066 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:15,066 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:15,066 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:15,066 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:15,486 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120124bbd767fef548d5abdc22d6d82b23fc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120124bbd767fef548d5abdc22d6d82b23fc 2023-04-04 17:54:15,896 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/1ab60422003e45f1a88eafd4c791868c 2023-04-04 17:54:15,908 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/1ab60422003e45f1a88eafd4c791868c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1ab60422003e45f1a88eafd4c791868c 2023-04-04 17:54:15,915 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1ab60422003e45f1a88eafd4c791868c, entries=1, sequenceid=13, filesize=5.0 K 2023-04-04 17:54:15,916 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 850ms, sequenceid=13, compaction requested=true 2023-04-04 17:54:15,916 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:15,916 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:15,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:15,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:15,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,917 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:15,917 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:15,918 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,918 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:15,919 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:15,919 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:15,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:15,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:15,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:15,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f6e522c[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:15,921 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:15,921 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,921 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,922 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:15,922 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:15,922 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:15,922 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,922 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:15,923 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:15,923 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:15,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,923 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:15,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:15,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:15,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:15,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:15,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:15,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:15,927 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:15,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:15,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:15,927 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,927 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:15,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:15,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,929 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:15,929 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:15,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,931 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:15,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:15,933 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:15,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:15,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:15,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:15,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:15,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:15,933 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:15,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:15,934 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:15,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:15,934 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:15,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:15,934 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,034 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:16,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:16,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:16,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:16,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,049 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:16,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:16,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:16,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:16,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,050 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,051 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,051 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:16,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:16,052 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,052 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,052 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,053 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:16,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,053 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:16,053 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:16,053 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:16,053 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:16,053 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:16,053 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:16,053 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:16,053 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:16,474 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205569760f0a2da4f8dbe5871b00a813f35 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205569760f0a2da4f8dbe5871b00a813f35 2023-04-04 17:54:16,882 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/9837f388d52144458e8b08e4e5968929 2023-04-04 17:54:16,889 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/9837f388d52144458e8b08e4e5968929 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/9837f388d52144458e8b08e4e5968929 2023-04-04 17:54:16,893 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/9837f388d52144458e8b08e4e5968929, entries=1, sequenceid=17, filesize=5.0 K 2023-04-04 17:54:16,894 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 841ms, sequenceid=17, compaction requested=true 2023-04-04 17:54:16,894 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:16,895 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:16,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:16,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:16,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:16,895 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:16,896 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,896 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:16,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:16,896 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,896 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:16,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:16,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:16,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:16,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:16,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@397c7be1[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:16,898 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:16,898 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,898 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,898 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:16,898 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:16,898 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,899 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:16,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:16,899 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:16,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:16,899 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:16,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:16,900 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:16,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:16,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:16,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:16,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:16,901 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:16,902 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:16,902 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:16,902 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,902 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:16,903 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,903 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:16,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,903 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:16,903 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,904 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,906 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:16,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:16,906 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:16,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:16,907 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:16,907 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:16,907 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:17,007 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:17,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:17,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:17,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:17,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,016 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:17,017 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:17,017 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:17,017 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:17,017 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,018 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,020 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:17,020 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:17,021 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,021 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:17,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:17,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,023 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:17,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:17,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:17,023 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:17,024 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:17,024 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:17,024 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:17,024 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:17,024 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:17,438 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122869e9c6e0ae834c819949a23a419afbb3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122869e9c6e0ae834c819949a23a419afbb3 2023-04-04 17:54:17,654 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:54:17,845 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/13d47a1a8a1f4bc18fa6e22f50e5a428 2023-04-04 17:54:17,856 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/13d47a1a8a1f4bc18fa6e22f50e5a428 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/13d47a1a8a1f4bc18fa6e22f50e5a428 2023-04-04 17:54:17,861 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/13d47a1a8a1f4bc18fa6e22f50e5a428, entries=1, sequenceid=21, filesize=5.0 K 2023-04-04 17:54:17,862 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 838ms, sequenceid=21, compaction requested=true 2023-04-04 17:54:17,863 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:17,863 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:17,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:17,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:17,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:17,863 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:17,864 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,864 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:17,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:17,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:17,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34944962[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:17,867 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:17,867 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,867 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,868 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:17,868 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:17,868 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:17,868 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,868 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:17,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:17,869 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:17,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:17,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:17,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:17,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:17,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:17,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:17,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:17,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:17,873 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:17,873 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:17,873 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:17,873 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,873 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:17,874 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,875 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,875 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:17,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:17,875 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:17,877 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:17,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:17,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:17,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:17,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:17,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:17,879 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:17,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:17,879 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:17,880 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,880 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:17,880 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:17,880 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:17,980 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:17,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:17,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:17,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:17,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,996 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:17,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:17,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:17,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:17,997 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,997 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:17,998 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:17,998 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:17,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:17,999 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:17,999 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:17,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:18,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,000 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,001 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:18,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:18,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:18,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:18,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:18,001 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:18,001 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:18,001 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:18,002 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:18,420 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c79a4b849edc420ab3ac2e197a71a7a7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231c79a4b849edc420ab3ac2e197a71a7a7 2023-04-04 17:54:18,827 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/921be9903ecd43c0a0cdddfbe02d3d2e 2023-04-04 17:54:18,832 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/921be9903ecd43c0a0cdddfbe02d3d2e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/921be9903ecd43c0a0cdddfbe02d3d2e 2023-04-04 17:54:18,837 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/921be9903ecd43c0a0cdddfbe02d3d2e, entries=1, sequenceid=25, filesize=5.0 K 2023-04-04 17:54:18,838 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 836ms, sequenceid=25, compaction requested=true 2023-04-04 17:54:18,838 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:18,838 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:18,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:18,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:18,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:18,839 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:18,840 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,840 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:18,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:18,841 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,841 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:18,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:18,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:18,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:18,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:18,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbabb59[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:18,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:18,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,844 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,844 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:18,844 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,844 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:18,844 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:18,844 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:18,845 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,845 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:18,845 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:18,845 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:18,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:18,848 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:18,848 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:18,848 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:18,848 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,848 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:18,849 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,849 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,850 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:18,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,850 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:18,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:18,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,852 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:18,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,855 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,855 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:18,855 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:18,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:18,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:18,855 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:18,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:18,855 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:18,855 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,855 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:18,856 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,856 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,856 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,856 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:18,856 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:18,956 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:18,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:18,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:18,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:18,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,965 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:18,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:18,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:18,965 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:18,966 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,966 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,967 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,967 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:18,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:18,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:18,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:18,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,969 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,970 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:18,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:18,970 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:18,970 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:18,970 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:18,970 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:18,971 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:18,971 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:18,971 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:18,971 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:19,397 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101df2523cbefc04bd889ab87d38c6e84b3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101df2523cbefc04bd889ab87d38c6e84b3 2023-04-04 17:54:19,805 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/009aa7c939f14eb0a5f592447789528d 2023-04-04 17:54:19,817 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/009aa7c939f14eb0a5f592447789528d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/009aa7c939f14eb0a5f592447789528d 2023-04-04 17:54:19,824 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/009aa7c939f14eb0a5f592447789528d, entries=1, sequenceid=29, filesize=5.0 K 2023-04-04 17:54:19,825 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 854ms, sequenceid=29, compaction requested=true 2023-04-04 17:54:19,825 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:19,825 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:19,825 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:19,825 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:19,825 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,825 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:19,825 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:19,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,827 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:19,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:19,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:19,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15875d0[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:19,829 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:19,829 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,829 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,830 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:19,830 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:19,830 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:19,830 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,830 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:19,831 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,831 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:19,831 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:19,832 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:19,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:19,834 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:19,834 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:19,834 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:19,834 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,834 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:19,835 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,835 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:19,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,835 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:19,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:19,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:19,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:19,835 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:19,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,836 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:19,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:19,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:19,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,837 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:19,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:19,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:19,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:19,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:19,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:19,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,838 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:19,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:19,838 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:19,938 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:19,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:19,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:19,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:19,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,956 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:19,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:19,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:19,956 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:19,957 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,957 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,958 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:19,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:19,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:19,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,959 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,959 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:19,960 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:19,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:19,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:19,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:19,960 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:20,380 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e046a040e3bb466bad0f8c6389240dc6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e046a040e3bb466bad0f8c6389240dc6 2023-04-04 17:54:20,788 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/a003ce139bc74d39a35399315c201975 2023-04-04 17:54:20,800 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/a003ce139bc74d39a35399315c201975 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/a003ce139bc74d39a35399315c201975 2023-04-04 17:54:20,806 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/a003ce139bc74d39a35399315c201975, entries=1, sequenceid=33, filesize=5.0 K 2023-04-04 17:54:20,807 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 847ms, sequenceid=33, compaction requested=true 2023-04-04 17:54:20,807 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:20,807 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:20,807 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:20,807 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:20,808 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,808 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:20,808 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:20,809 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,809 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:20,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:20,810 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,810 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:20,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:20,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:20,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:20,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:20,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ba1a569[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:20,812 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:20,812 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,813 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,813 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:20,813 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:20,813 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:20,813 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,813 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:20,814 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,814 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:20,815 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:20,815 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:20,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:20,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:20,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:20,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:20,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:20,818 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:20,818 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:20,818 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:20,818 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,818 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:20,820 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,820 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:20,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,820 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:20,821 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,822 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:20,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,825 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,825 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:20,825 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:20,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:20,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:20,825 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,825 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:20,825 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:20,826 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:20,826 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,826 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:20,826 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:20,826 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,826 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:20,926 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:20,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:20,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:20,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:20,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,934 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:20,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:20,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:20,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:20,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,936 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,937 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:20,937 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:20,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:20,938 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:20,938 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:20,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:20,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:20,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:20,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:20,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:20,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:20,941 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:20,941 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:20,941 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:21,365 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075f0e34c923a04fdebd042a6d7ae1e0c4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509075f0e34c923a04fdebd042a6d7ae1e0c4 2023-04-04 17:54:21,775 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/eb65184b433b44c5b8e6e1be172e75b2 2023-04-04 17:54:21,786 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/eb65184b433b44c5b8e6e1be172e75b2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/eb65184b433b44c5b8e6e1be172e75b2 2023-04-04 17:54:21,790 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/eb65184b433b44c5b8e6e1be172e75b2, entries=1, sequenceid=37, filesize=5.0 K 2023-04-04 17:54:21,791 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 850ms, sequenceid=37, compaction requested=true 2023-04-04 17:54:21,791 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:21,791 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:21,791 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:21,791 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:21,791 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,791 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:21,792 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:21,793 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,793 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:21,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:21,793 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,793 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:21,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:21,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:21,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:21,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:21,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4de82826[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:21,794 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:21,794 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,795 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,795 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:21,795 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,795 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:21,795 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:21,795 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:21,796 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,796 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:21,796 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:21,796 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:21,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:21,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:21,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:21,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:21,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:21,800 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:21,800 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:21,800 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:21,800 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,800 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:21,801 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,801 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,801 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:21,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:21,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:21,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,802 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:21,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:21,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,803 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:21,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,806 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,806 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:21,806 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:21,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:21,806 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,806 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:21,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:21,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:21,806 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:21,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-04 17:54:21,807 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:21,806 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:21,807 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,807 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:21,807 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:21,807 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,907 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:21,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:21,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,923 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:21,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:21,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-04 17:54:21,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-04 17:54:21,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,924 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:21,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:21,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:21,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-04 17:54:21,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:21,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-04 17:54:21,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:21,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-04 17:54:21,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:21,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:21,926 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:21,926 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. started... 2023-04-04 17:54:21,926 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa30c35db7c8b3298d236a5ab793eaab 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:22,346 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fb2206a431214d6680147706b14c24dc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fb2206a431214d6680147706b14c24dc 2023-04-04 17:54:22,752 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/cc49b796a31a4d379f4219b024583718 2023-04-04 17:54:22,765 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/cc49b796a31a4d379f4219b024583718 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/cc49b796a31a4d379f4219b024583718 2023-04-04 17:54:22,771 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/cc49b796a31a4d379f4219b024583718, entries=1, sequenceid=41, filesize=5.0 K 2023-04-04 17:54:22,771 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa30c35db7c8b3298d236a5ab793eaab in 845ms, sequenceid=41, compaction requested=true 2023-04-04 17:54:22,772 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:22,772 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:22,772 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:22,772 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:22,772 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,772 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-04 17:54:22,772 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-04 17:54:22,773 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,773 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:22,774 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,774 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:22,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:22,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:22,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-04 17:54:22,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44122b1[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:22,776 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-04 17:54:22,776 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,777 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,777 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-04 17:54:22,777 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-04 17:54:22,777 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,777 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:22,777 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:22,779 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,779 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-04 17:54:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:22,779 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:22,779 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-04 17:54:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:22,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:22,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:22,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:22,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-04 17:54:22,783 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-04 17:54:22,783 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:22,783 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:22,783 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,783 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:22,784 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,785 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:22,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,785 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:22,785 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,787 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:22,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,789 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,789 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,789 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-04 17:54:22,790 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:22,789 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:22,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:22,790 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:22,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:22,789 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:22,790 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,790 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,790 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,790 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:22,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:22,790 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:22,891 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:22,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:22,897 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:22,904 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:22,904 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:22,905 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:22,905 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631462905 2023-04-04 17:54:22,907 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:54:22,908 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-04-04 17:54:22,908 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:22,908 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x1bf317f2 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:22,911 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e648bde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:22,911 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,751 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010372ad449898f04b2a8a0caff2d2ba2e10 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010372ad449898f04b2a8a0caff2d2ba2e10 2023-04-04 17:54:23,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:23,767 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:54:23,768 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:54:23,774 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:54:23,776 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:54:23,785 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d33228d29bd440f3bab7f2bea8529e67 first=Optional[r3] last=Optional[r6] 2023-04-04 17:54:23,786 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d33228d29bd440f3bab7f2bea8529e67}] 2023-04-04 17:54:23,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d33228d29bd440f3bab7f2bea8529e67 for inclusion in fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:23,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-04 17:54:23,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:23,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:23,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d33228d29bd440f3bab7f2bea8529e67 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__27snoopikcjv2mb6rtm8rtls7krlr3hn4sdgucvl5jomngigt7ptkvutnijj66lt/family1/d33228d29bd440f3bab7f2bea8529e67 2023-04-04 17:54:23,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__27snoopikcjv2mb6rtm8rtls7krlr3hn4sdgucvl5jomngigt7ptkvutnijj66lt/family1/d33228d29bd440f3bab7f2bea8529e67 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_ 2023-04-04 17:54:23,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__27snoopikcjv2mb6rtm8rtls7krlr3hn4sdgucvl5jomngigt7ptkvutnijj66lt/family1/d33228d29bd440f3bab7f2bea8529e67 into fa30c35db7c8b3298d236a5ab793eaab/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_ - updating store file list. 2023-04-04 17:54:23,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_ into fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:23,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__27snoopikcjv2mb6rtm8rtls7krlr3hn4sdgucvl5jomngigt7ptkvutnijj66lt/family1/d33228d29bd440f3bab7f2bea8529e67 into fa30c35db7c8b3298d236a5ab793eaab/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_) 2023-04-04 17:54:23,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__27snoopikcjv2mb6rtm8rtls7krlr3hn4sdgucvl5jomngigt7ptkvutnijj66lt/family1/d33228d29bd440f3bab7f2bea8529e67 2023-04-04 17:54:23,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-04 17:54:23,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-04 17:54:23,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): fa30c35db7c8b3298d236a5ab793eaab/family1 is initiating minor compaction 2023-04-04 17:54:23,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@22621030; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:23,805 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fa30c35db7c8b3298d236a5ab793eaab/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:23,805 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/022da837992f493da7bcceac8164347e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1ab60422003e45f1a88eafd4c791868c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/9837f388d52144458e8b08e4e5968929, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/13d47a1a8a1f4bc18fa6e22f50e5a428, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/921be9903ecd43c0a0cdddfbe02d3d2e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/009aa7c939f14eb0a5f592447789528d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/a003ce139bc74d39a35399315c201975, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/eb65184b433b44c5b8e6e1be172e75b2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/cc49b796a31a4d379f4219b024583718, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp, totalSize=50.4 K 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 022da837992f493da7bcceac8164347e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 1ab60422003e45f1a88eafd4c791868c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 9837f388d52144458e8b08e4e5968929, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 13d47a1a8a1f4bc18fa6e22f50e5a428, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 921be9903ecd43c0a0cdddfbe02d3d2e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 009aa7c939f14eb0a5f592447789528d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting a003ce139bc74d39a35399315c201975, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting eb65184b433b44c5b8e6e1be172e75b2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-04 17:54:23,805 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting cc49b796a31a4d379f4219b024583718, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-04 17:54:23,806 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-04 17:54:23,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:23,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:23,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122869e9c6e0ae834c819949a23a419afbb3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122869e9c6e0ae834c819949a23a419afbb3 2023-04-04 17:54:23,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231c79a4b849edc420ab3ac2e197a71a7a7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231c79a4b849edc420ab3ac2e197a71a7a7 2023-04-04 17:54:23,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101df2523cbefc04bd889ab87d38c6e84b3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101df2523cbefc04bd889ab87d38c6e84b3 2023-04-04 17:54:23,813 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e046a040e3bb466bad0f8c6389240dc6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e046a040e3bb466bad0f8c6389240dc6 2023-04-04 17:54:23,813 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-04-04 17:54:23,813 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:23,835 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): fa30c35db7c8b3298d236a5ab793eaab#family1#compaction#61 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-04 17:54:24,669 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/00ba7c6149f9450f9a65733b5413c60a as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/00ba7c6149f9450f9a65733b5413c60a 2023-04-04 17:54:24,671 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120548f12b0b171449478d0f27d91da3d715 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120548f12b0b171449478d0f27d91da3d715 2023-04-04 17:54:24,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:24,676 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fa30c35db7c8b3298d236a5ab793eaab/family1 of fa30c35db7c8b3298d236a5ab793eaab into 00ba7c6149f9450f9a65733b5413c60a(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:54:24,676 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:24,676 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1680630863804; duration=0sec 2023-04-04 17:54:24,676 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:24,694 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/30ba4377e80d435193c73e079087c084 first=Optional[r00] last=Optional[r2] 2023-04-04 17:54:24,695 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/30ba4377e80d435193c73e079087c084}] 2023-04-04 17:54:24,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/30ba4377e80d435193c73e079087c084 for inclusion in fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:24,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-04 17:54:24,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:24,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:24,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/30ba4377e80d435193c73e079087c084 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ks2lv22j326c5ejai5jonbnn3onn7q4d5qbifmba06ttbnct8u4rj3fodjkm3mjm/family1/30ba4377e80d435193c73e079087c084 2023-04-04 17:54:24,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ks2lv22j326c5ejai5jonbnn3onn7q4d5qbifmba06ttbnct8u4rj3fodjkm3mjm/family1/30ba4377e80d435193c73e079087c084 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_ 2023-04-04 17:54:24,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ks2lv22j326c5ejai5jonbnn3onn7q4d5qbifmba06ttbnct8u4rj3fodjkm3mjm/family1/30ba4377e80d435193c73e079087c084 into fa30c35db7c8b3298d236a5ab793eaab/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_ - updating store file list. 2023-04-04 17:54:24,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_ into fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:24,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ks2lv22j326c5ejai5jonbnn3onn7q4d5qbifmba06ttbnct8u4rj3fodjkm3mjm/family1/30ba4377e80d435193c73e079087c084 into fa30c35db7c8b3298d236a5ab793eaab/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_) 2023-04-04 17:54:24,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ks2lv22j326c5ejai5jonbnn3onn7q4d5qbifmba06ttbnct8u4rj3fodjkm3mjm/family1/30ba4377e80d435193c73e079087c084 2023-04-04 17:54:24,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:54:24,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:54:24,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): fa30c35db7c8b3298d236a5ab793eaab/family1 is initiating minor compaction (all files) 2023-04-04 17:54:24,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4bdd5ff2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-04 17:54:24,710 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fa30c35db7c8b3298d236a5ab793eaab/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:24,710 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/d5349175577a44f4b3ca49abbd17b4bb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/00ba7c6149f9450f9a65733b5413c60a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp, totalSize=390.1 K 2023-04-04 17:54:24,710 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting d5349175577a44f4b3ca49abbd17b4bb, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809546 2023-04-04 17:54:24,711 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 00ba7c6149f9450f9a65733b5413c60a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209546 2023-04-04 17:54:24,711 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 3a31a0b3ea904a50aab663abd332fd62_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809546 2023-04-04 17:54:24,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:24,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:24,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113013f390318883448c90ce060f5fa76736 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113013f390318883448c90ce060f5fa76736 2023-04-04 17:54:24,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120124bbd767fef548d5abdc22d6d82b23fc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120124bbd767fef548d5abdc22d6d82b23fc 2023-04-04 17:54:24,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205569760f0a2da4f8dbe5871b00a813f35 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205569760f0a2da4f8dbe5871b00a813f35 2023-04-04 17:54:24,718 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-04-04 17:54:24,718 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-04 17:54:24,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:24,718 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:24,718 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:24,720 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:24,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8220 sec 2023-04-04 17:54:24,728 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): fa30c35db7c8b3298d236a5ab793eaab#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-04 17:54:24,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/022da837992f493da7bcceac8164347e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1ab60422003e45f1a88eafd4c791868c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/9837f388d52144458e8b08e4e5968929, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/13d47a1a8a1f4bc18fa6e22f50e5a428, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/921be9903ecd43c0a0cdddfbe02d3d2e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/009aa7c939f14eb0a5f592447789528d, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/a003ce139bc74d39a35399315c201975, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/eb65184b433b44c5b8e6e1be172e75b2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/cc49b796a31a4d379f4219b024583718, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_] to archive 2023-04-04 17:54:24,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:24,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/022da837992f493da7bcceac8164347e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/022da837992f493da7bcceac8164347e 2023-04-04 17:54:24,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1ab60422003e45f1a88eafd4c791868c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1ab60422003e45f1a88eafd4c791868c 2023-04-04 17:54:24,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/9837f388d52144458e8b08e4e5968929 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/9837f388d52144458e8b08e4e5968929 2023-04-04 17:54:24,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/13d47a1a8a1f4bc18fa6e22f50e5a428 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/13d47a1a8a1f4bc18fa6e22f50e5a428 2023-04-04 17:54:24,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/921be9903ecd43c0a0cdddfbe02d3d2e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/921be9903ecd43c0a0cdddfbe02d3d2e 2023-04-04 17:54:24,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/009aa7c939f14eb0a5f592447789528d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/009aa7c939f14eb0a5f592447789528d 2023-04-04 17:54:24,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/a003ce139bc74d39a35399315c201975 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/a003ce139bc74d39a35399315c201975 2023-04-04 17:54:24,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/eb65184b433b44c5b8e6e1be172e75b2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/eb65184b433b44c5b8e6e1be172e75b2 2023-04-04 17:54:24,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/cc49b796a31a4d379f4219b024583718 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/cc49b796a31a4d379f4219b024583718 2023-04-04 17:54:24,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/1bb6cc3e73114cf1bb1bfd9c4a08342c_SeqId_44_ 2023-04-04 17:54:24,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-04 17:54:24,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:25,217 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-04-04 17:54:25,220 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-04-04 17:54:25,220 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-04-04 17:54:25,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-04-04 17:54:25,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE}] 2023-04-04 17:54:25,231 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE 2023-04-04 17:54:25,232 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:25,232 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630865232"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630865232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630865232"}]},"ts":"1680630865232"} 2023-04-04 17:54:25,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:25,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:25,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fa30c35db7c8b3298d236a5ab793eaab, disabling compactions & flushes 2023-04-04 17:54:25,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:25,959 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/.tmp/family1/91a030d50aed441e84c61968373cde46 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/91a030d50aed441e84c61968373cde46 2023-04-04 17:54:25,966 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fa30c35db7c8b3298d236a5ab793eaab/family1 of fa30c35db7c8b3298d236a5ab793eaab into 91a030d50aed441e84c61968373cde46(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:54:25,966 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:25,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:25,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:25,966 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1680630864709; duration=1sec 2023-04-04 17:54:25,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. after waiting 0 ms 2023-04-04 17:54:25,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:25,966 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:25,967 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/d5349175577a44f4b3ca49abbd17b4bb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/00ba7c6149f9450f9a65733b5413c60a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_] to archive 2023-04-04 17:54:25,967 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:25,970 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/d5349175577a44f4b3ca49abbd17b4bb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/d5349175577a44f4b3ca49abbd17b4bb 2023-04-04 17:54:25,972 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/00ba7c6149f9450f9a65733b5413c60a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/00ba7c6149f9450f9a65733b5413c60a 2023-04-04 17:54:25,974 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/3a31a0b3ea904a50aab663abd332fd62_SeqId_47_ 2023-04-04 17:54:25,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-04 17:54:25,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:25,980 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3509): Not adding moved region record: fa30c35db7c8b3298d236a5ab793eaab to self. 2023-04-04 17:54:25,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:25,982 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=CLOSED 2023-04-04 17:54:25,982 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630865982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630865982"}]},"ts":"1680630865982"} 2023-04-04 17:54:25,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-04-04 17:54:25,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259 in 749 msec 2023-04-04 17:54:25,985 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=true 2023-04-04 17:54:26,136 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:26,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630866136"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630866136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630866136"}]},"ts":"1680630866136"} 2023-04-04 17:54:26,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:26,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:26,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa30c35db7c8b3298d236a5ab793eaab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:54:26,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:26,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:26,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:26,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:26,306 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:26,307 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:26,307 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:26,308 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa30c35db7c8b3298d236a5ab793eaab columnFamilyName family1 2023-04-04 17:54:26,313 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/91a030d50aed441e84c61968373cde46 2023-04-04 17:54:26,313 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(310): Store=fa30c35db7c8b3298d236a5ab793eaab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:26,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:26,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:26,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:26,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fa30c35db7c8b3298d236a5ab793eaab; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67364680, jitterRate=0.003811955451965332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:54:26,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:26,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., pid=47, masterSystemTime=1680630866294 2023-04-04 17:54:26,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:26,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:26,322 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:26,322 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630866322"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630866322"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630866322"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630866322"}]},"ts":"1680630866322"} 2023-04-04 17:54:26,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-04-04 17:54:26,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259 in 183 msec 2023-04-04 17:54:26,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-04-04 17:54:26,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE in 1.0960 sec 2023-04-04 17:54:26,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-04-04 17:54:26,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1010 sec 2023-04-04 17:54:26,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5230 sec 2023-04-04 17:54:26,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-04-04 17:54:26,331 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(278): alter status finished 2023-04-04 17:54:26,331 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:26,333 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:26,334 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:26,334 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:26,334 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631466334 2023-04-04 17:54:26,335 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:54:26,336 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-04-04 17:54:26,336 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:26,336 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x53d95a39 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:26,340 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@299901e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:26,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,774 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c065a5e41eb445818e059cb3e265c388 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c065a5e41eb445818e059cb3e265c388 2023-04-04 17:54:26,776 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:26,793 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:54:26,794 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:54:26,800 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:54:26,801 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:54:26,810 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d30cae1aa684d88afd819eb70a197ba first=Optional[r05] last=Optional[r8] 2023-04-04 17:54:26,810 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d30cae1aa684d88afd819eb70a197ba}] 2023-04-04 17:54:26,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d30cae1aa684d88afd819eb70a197ba for inclusion in fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:26,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-04-04 17:54:26,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:26,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:26,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d30cae1aa684d88afd819eb70a197ba to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n6n8jirtmgncqs52bkd6b978tnlve6gbcet8anujl76k3oe9j59d2avppp41jaf8/family1/6d30cae1aa684d88afd819eb70a197ba 2023-04-04 17:54:26,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n6n8jirtmgncqs52bkd6b978tnlve6gbcet8anujl76k3oe9j59d2avppp41jaf8/family1/6d30cae1aa684d88afd819eb70a197ba as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/8e259a97a1e04853a2d7f6f43517b11e_SeqId_53_ 2023-04-04 17:54:26,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n6n8jirtmgncqs52bkd6b978tnlve6gbcet8anujl76k3oe9j59d2avppp41jaf8/family1/6d30cae1aa684d88afd819eb70a197ba into fa30c35db7c8b3298d236a5ab793eaab/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/8e259a97a1e04853a2d7f6f43517b11e_SeqId_53_ - updating store file list. 2023-04-04 17:54:26,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/8e259a97a1e04853a2d7f6f43517b11e_SeqId_53_ into fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:26,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n6n8jirtmgncqs52bkd6b978tnlve6gbcet8anujl76k3oe9j59d2avppp41jaf8/family1/6d30cae1aa684d88afd819eb70a197ba into fa30c35db7c8b3298d236a5ab793eaab/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/8e259a97a1e04853a2d7f6f43517b11e_SeqId_53_) 2023-04-04 17:54:26,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n6n8jirtmgncqs52bkd6b978tnlve6gbcet8anujl76k3oe9j59d2avppp41jaf8/family1/6d30cae1aa684d88afd819eb70a197ba 2023-04-04 17:54:26,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:26,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:26,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fb2206a431214d6680147706b14c24dc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fb2206a431214d6680147706b14c24dc 2023-04-04 17:54:26,836 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289546cb43014741849d2521ddde8a66eb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289546cb43014741849d2521ddde8a66eb 2023-04-04 17:54:26,836 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-04-04 17:54:26,836 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-04 17:54:26,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:26,837 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:26,837 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:26,838 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:26,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 506 msec 2023-04-04 17:54:26,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-04 17:54:26,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:27,304 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-04-04 17:54:27,307 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-04-04 17:54:27,308 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-04-04 17:54:27,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-04-04 17:54:27,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE}] 2023-04-04 17:54:27,318 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE 2023-04-04 17:54:27,319 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:27,319 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630867319"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630867319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630867319"}]},"ts":"1680630867319"} 2023-04-04 17:54:27,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:27,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fa30c35db7c8b3298d236a5ab793eaab, disabling compactions & flushes 2023-04-04 17:54:27,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:27,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:27,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. after waiting 0 ms 2023-04-04 17:54:27,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:27,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-04-04 17:54:27,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:27,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:27,487 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3509): Not adding moved region record: fa30c35db7c8b3298d236a5ab793eaab to self. 2023-04-04 17:54:27,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,489 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=CLOSED 2023-04-04 17:54:27,489 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630867489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630867489"}]},"ts":"1680630867489"} 2023-04-04 17:54:27,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-04-04 17:54:27,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259 in 170 msec 2023-04-04 17:54:27,493 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=true 2023-04-04 17:54:27,644 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:27,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630867644"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630867644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630867644"}]},"ts":"1680630867644"} 2023-04-04 17:54:27,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:27,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:27,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa30c35db7c8b3298d236a5ab793eaab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:54:27,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:27,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,817 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,819 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:27,819 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1 2023-04-04 17:54:27,819 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa30c35db7c8b3298d236a5ab793eaab columnFamilyName family1 2023-04-04 17:54:27,826 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/8e259a97a1e04853a2d7f6f43517b11e_SeqId_53_ 2023-04-04 17:54:27,830 DEBUG [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/family1/91a030d50aed441e84c61968373cde46 2023-04-04 17:54:27,830 INFO [StoreOpener-fa30c35db7c8b3298d236a5ab793eaab-1] regionserver.HStore(310): Store=fa30c35db7c8b3298d236a5ab793eaab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:27,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:54:27,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fa30c35db7c8b3298d236a5ab793eaab; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64501363, jitterRate=-0.03885479271411896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:54:27,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:54:27,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab., pid=53, masterSystemTime=1680630867803 2023-04-04 17:54:27,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:27,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:54:27,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fa30c35db7c8b3298d236a5ab793eaab, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:27,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680630867841"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630867841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630867841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630867841"}]},"ts":"1680630867841"} 2023-04-04 17:54:27,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-04-04 17:54:27,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure fa30c35db7c8b3298d236a5ab793eaab, server=jenkins-hbase17.apache.org,46251,1680630785259 in 194 msec 2023-04-04 17:54:27,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-04-04 17:54:27,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fa30c35db7c8b3298d236a5ab793eaab, REOPEN/MOVE in 528 msec 2023-04-04 17:54:27,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-04-04 17:54:27,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 534 msec 2023-04-04 17:54:27,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 956 msec 2023-04-04 17:54:27,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-04-04 17:54:27,851 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(278): alter status finished 2023-04-04 17:54:27,852 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-04 17:54:27,853 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:27,854 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:27,854 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:27,854 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631467854 2023-04-04 17:54:27,855 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:54:27,856 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-04-04 17:54:27,856 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:27,856 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x2bfe94f5 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:27,859 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a093e54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-04 17:54:27,860 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-04 17:54:27,860 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:27,862 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-04 17:54:27,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-04-04 17:54:27,905 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=244 (was 245), OpenFileDescriptor=616 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 176), ProcessCount=174 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=7646 (was 7661) 2023-04-04 17:54:27,916 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=144, ProcessCount=174, AvailableMemoryMB=7646 2023-04-04 17:54:27,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-04 17:54:27,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:27,920 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:54:27,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-04-04 17:54:27,920 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:54:27,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-04 17:54:27,921 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:27,922 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb empty. 2023-04-04 17:54:27,922 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:27,923 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-04-04 17:54:28,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-04 17:54:28,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-04 17:54:28,335 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-04-04 17:54:28,337 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2f230c29a6626fee30f4fe9a22bda5eb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:54:28,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-04 17:54:28,748 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:28,749 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 2f230c29a6626fee30f4fe9a22bda5eb, disabling compactions & flushes 2023-04-04 17:54:28,749 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:28,749 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:28,749 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. after waiting 0 ms 2023-04-04 17:54:28,749 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:28,749 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:28,749 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:28,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:54:28,753 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630868753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630868753"}]},"ts":"1680630868753"} 2023-04-04 17:54:28,755 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:54:28,756 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:54:28,757 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630868757"}]},"ts":"1680630868757"} 2023-04-04 17:54:28,759 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-04-04 17:54:28,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, ASSIGN}] 2023-04-04 17:54:28,763 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, ASSIGN 2023-04-04 17:54:28,764 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:54:28,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:28,916 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630868915"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630868915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630868915"}]},"ts":"1680630868915"} 2023-04-04 17:54:28,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:29,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-04 17:54:29,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:29,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f230c29a6626fee30f4fe9a22bda5eb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:54:29,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:29,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:29,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:29,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:29,082 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:29,085 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:29,085 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:29,085 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f230c29a6626fee30f4fe9a22bda5eb columnFamilyName family1 2023-04-04 17:54:29,087 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(310): Store=2f230c29a6626fee30f4fe9a22bda5eb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:29,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:29,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:29,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:29,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:54:29,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2f230c29a6626fee30f4fe9a22bda5eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63249094, jitterRate=-0.05751505494117737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:54:29,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:29,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., pid=57, masterSystemTime=1680630869072 2023-04-04 17:54:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:29,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:29,097 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:29,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630869097"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630869097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630869097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630869097"}]},"ts":"1680630869097"} 2023-04-04 17:54:29,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-04-04 17:54:29,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259 in 180 msec 2023-04-04 17:54:29,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-04-04 17:54:29,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, ASSIGN in 339 msec 2023-04-04 17:54:29,103 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:54:29,103 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630869103"}]},"ts":"1680630869103"} 2023-04-04 17:54:29,104 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-04-04 17:54:29,106 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:54:29,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1880 sec 2023-04-04 17:54:30,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-04 17:54:30,033 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-04-04 17:54:30,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:30,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,062 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:30,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:30,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:30,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:30,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,063 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:30,063 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:30,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:30,063 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,063 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:30,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:30,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,064 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:30,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:30,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:30,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:30,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:30,064 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:30,065 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:30,065 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-04 17:54:30,496 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e7fef150db704ab4b1e8144d2a30206f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e7fef150db704ab4b1e8144d2a30206f 2023-04-04 17:54:30,567 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:30,900 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/edcc172b4ed6465bbda232a1d358b01b 2023-04-04 17:54:30,905 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/edcc172b4ed6465bbda232a1d358b01b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/edcc172b4ed6465bbda232a1d358b01b 2023-04-04 17:54:30,909 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/edcc172b4ed6465bbda232a1d358b01b, entries=1000, sequenceid=5, filesize=190.5 K 2023-04-04 17:54:30,909 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 844ms, sequenceid=5, compaction requested=false 2023-04-04 17:54:30,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:30,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:30,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:30,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:30,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:30,910 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:30,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,912 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:30,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:30,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,912 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:30,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:30,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:30,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4675211c[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:30,914 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:30,914 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,914 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,915 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:30,915 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:30,915 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,915 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:30,915 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:30,915 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,915 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:30,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:30,916 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:30,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:30,918 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:30,918 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:30,918 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:30,918 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,918 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:30,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:30,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,919 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:30,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:30,919 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,920 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:30,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,922 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,922 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:30,923 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:30,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:30,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:30,923 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:31,023 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:31,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:31,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:31,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:31,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,030 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:31,030 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:31,030 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:31,030 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:31,031 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,031 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,031 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:31,031 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:31,032 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,032 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,033 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:31,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,033 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:31,033 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:31,033 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:31,033 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:31,033 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:31,033 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:31,033 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:31,033 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-04 17:54:31,447 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285d0b2fa3a34b484a9ad97f085ad7ad30 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285d0b2fa3a34b484a9ad97f085ad7ad30 2023-04-04 17:54:31,508 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:54:31,855 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/6bfbbd40c0ea4585bce06d8ee4159936 2023-04-04 17:54:31,863 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/6bfbbd40c0ea4585bce06d8ee4159936 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/6bfbbd40c0ea4585bce06d8ee4159936 2023-04-04 17:54:31,868 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/6bfbbd40c0ea4585bce06d8ee4159936, entries=1, sequenceid=9, filesize=5.0 K 2023-04-04 17:54:31,868 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 835ms, sequenceid=9, compaction requested=false 2023-04-04 17:54:31,869 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:31,869 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:31,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:31,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:31,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:31,869 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:31,870 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,870 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:31,870 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,870 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:31,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:31,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:31,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:31,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10a95e56[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:31,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:31,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,872 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,872 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:31,873 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:31,873 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:31,873 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,873 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:31,873 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:31,873 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,873 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:31,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:31,874 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:31,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:31,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:31,876 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:31,876 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:31,876 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:31,876 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,876 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:31,877 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,877 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,877 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:31,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:31,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:31,878 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,879 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:31,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:31,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:31,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:31,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:31,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:31,881 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:31,882 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:31,881 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,882 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,882 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:31,982 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:31,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:31,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:31,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:31,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,992 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:31,992 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:31,992 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:31,992 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:31,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,993 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,993 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:31,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:31,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:31,994 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:31,994 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:31,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:31,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,995 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:31,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:31,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:31,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:31,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:31,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:31,995 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:31,995 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:31,995 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:31,995 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:32,412 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013f840ae6c4b84058992cf58a6bedf0f6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512013f840ae6c4b84058992cf58a6bedf0f6 2023-04-04 17:54:32,818 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/06dfbc6544df4be68ee09cd47a3b23f1 2023-04-04 17:54:32,822 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/06dfbc6544df4be68ee09cd47a3b23f1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/06dfbc6544df4be68ee09cd47a3b23f1 2023-04-04 17:54:32,826 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/06dfbc6544df4be68ee09cd47a3b23f1, entries=1, sequenceid=13, filesize=5.0 K 2023-04-04 17:54:32,827 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 832ms, sequenceid=13, compaction requested=true 2023-04-04 17:54:32,827 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:32,827 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:32,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:32,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:32,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:32,827 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:32,828 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,828 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:32,829 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,829 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:32,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:32,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c8cfd7d[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:32,830 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:32,830 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,830 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,831 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:32,831 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,831 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:32,831 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:32,831 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:32,831 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:32,832 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:32,832 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,832 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:32,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:32,834 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:32,834 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:32,834 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:32,834 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,834 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:32,835 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,835 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,835 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:32,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:32,835 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,836 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:32,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,837 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:32,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:32,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:32,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,838 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:32,838 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:32,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:32,939 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:32,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:32,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:32,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:32,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,947 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:32,947 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:32,947 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:32,947 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:32,948 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,948 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,949 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:32,949 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:32,950 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:32,950 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,952 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,952 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:32,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:32,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:32,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:32,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:32,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:32,953 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:32,953 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:32,953 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:32,954 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:33,377 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a40f02374dbe4dae8f7e36d29447662e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a40f02374dbe4dae8f7e36d29447662e 2023-04-04 17:54:33,784 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/926ec810a0d644d280c89f8cca29cb45 2023-04-04 17:54:33,795 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/926ec810a0d644d280c89f8cca29cb45 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/926ec810a0d644d280c89f8cca29cb45 2023-04-04 17:54:33,801 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/926ec810a0d644d280c89f8cca29cb45, entries=1, sequenceid=17, filesize=5.0 K 2023-04-04 17:54:33,802 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 849ms, sequenceid=17, compaction requested=true 2023-04-04 17:54:33,802 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:33,802 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:33,802 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:33,802 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:33,802 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,802 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:33,802 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:33,804 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,804 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:33,805 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:33,805 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:33,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:33,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:33,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d500f7[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:33,807 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:33,807 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,808 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,808 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:33,808 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:33,808 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:33,808 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,808 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:33,809 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,809 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:33,809 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:33,810 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:33,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:33,813 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:33,813 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:33,813 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:33,813 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,813 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:33,814 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,814 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:33,814 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,815 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:33,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,816 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,819 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:33,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:33,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:33,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:33,819 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:33,920 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:33,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:33,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:33,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:33,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,934 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:33,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:33,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:33,934 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:33,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,935 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,937 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,937 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:33,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:33,937 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:33,938 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:33,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:33,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:33,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:33,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:33,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:33,940 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:33,941 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:33,941 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:33,941 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:34,362 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228310efa8b3b594830bde9b7ce13ef5ba8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228310efa8b3b594830bde9b7ce13ef5ba8 2023-04-04 17:54:34,769 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/a508e2599f2644cc825509ce6e845408 2023-04-04 17:54:34,779 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/a508e2599f2644cc825509ce6e845408 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/a508e2599f2644cc825509ce6e845408 2023-04-04 17:54:34,783 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/a508e2599f2644cc825509ce6e845408, entries=1, sequenceid=21, filesize=5.0 K 2023-04-04 17:54:34,784 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 843ms, sequenceid=21, compaction requested=true 2023-04-04 17:54:34,784 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:34,784 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:34,784 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:34,784 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:34,784 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,784 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:34,784 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:34,785 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,785 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:34,786 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,786 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:34,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:34,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ec7be10[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:34,787 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:34,787 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,788 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:34,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:34,788 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:34,788 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,788 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:34,789 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:34,789 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:34,789 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,789 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:34,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:34,791 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:34,791 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:34,791 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:34,791 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,791 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:34,791 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,791 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:34,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,791 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:34,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:34,792 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,793 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,794 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:34,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:34,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:34,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:34,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:34,794 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,795 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:34,895 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:34,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:34,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:34,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:34,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,901 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:34,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:34,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:34,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:34,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,901 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,902 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:34,902 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:34,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:34,902 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:34,902 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:34,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,903 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,903 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:34,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:34,903 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:34,904 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:34,904 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:34,904 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:34,904 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:34,904 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:34,904 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:34,904 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:35,320 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311b831a7e550b4d0188ea6e46bb21b4d7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311b831a7e550b4d0188ea6e46bb21b4d7 2023-04-04 17:54:35,728 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/7c1ca1b91dd84c65bd49c3b59701cf5f 2023-04-04 17:54:35,740 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/7c1ca1b91dd84c65bd49c3b59701cf5f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7c1ca1b91dd84c65bd49c3b59701cf5f 2023-04-04 17:54:35,746 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7c1ca1b91dd84c65bd49c3b59701cf5f, entries=1, sequenceid=25, filesize=5.0 K 2023-04-04 17:54:35,747 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 842ms, sequenceid=25, compaction requested=true 2023-04-04 17:54:35,747 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:35,747 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:35,747 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:35,747 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:35,747 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,747 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:35,747 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:35,748 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,748 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:35,748 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,748 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:35,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:35,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24460470[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:35,749 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:35,749 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,750 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,750 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:35,750 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:35,750 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:35,750 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,750 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:35,751 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:35,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:35,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:35,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:35,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:35,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:35,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:35,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:35,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:35,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:35,753 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:35,753 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:35,753 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:35,753 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,753 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:35,754 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,754 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:35,755 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,755 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:35,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,756 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:35,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,758 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,758 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:35,758 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:35,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:35,758 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,758 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:35,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:35,758 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:35,759 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:35,759 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:35,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:35,758 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:35,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:35,759 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,759 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,759 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,859 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:35,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:35,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:35,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:35,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,871 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:35,871 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:35,871 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:35,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:35,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,872 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,874 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:35,874 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:35,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:35,874 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:35,874 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:35,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,876 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:35,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:35,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:35,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:35,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:35,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:35,877 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:35,877 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:35,877 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:35,877 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:36,304 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f06f08cb3ba5422983a726d4c79544ff to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f06f08cb3ba5422983a726d4c79544ff 2023-04-04 17:54:36,714 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/8f4e9a9117244f80a10d9beed959ca72 2023-04-04 17:54:36,727 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/8f4e9a9117244f80a10d9beed959ca72 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/8f4e9a9117244f80a10d9beed959ca72 2023-04-04 17:54:36,732 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/8f4e9a9117244f80a10d9beed959ca72, entries=1, sequenceid=29, filesize=5.0 K 2023-04-04 17:54:36,733 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 855ms, sequenceid=29, compaction requested=true 2023-04-04 17:54:36,733 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:36,733 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:36,733 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:36,733 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:36,733 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,733 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:36,733 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:36,734 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,734 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:36,734 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,735 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:36,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:36,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f5a6290[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:36,736 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:36,736 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,737 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,737 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:36,737 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:36,737 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,737 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:36,737 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:36,738 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,738 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:36,738 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:36,738 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:36,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:36,741 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:36,741 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:36,741 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:36,741 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,741 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:36,743 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,743 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,743 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:36,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:36,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:36,743 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,745 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:36,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:36,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:36,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:36,747 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:36,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:36,748 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:36,748 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,848 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:36,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:36,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:36,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:36,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,861 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:36,861 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:36,861 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:36,861 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:36,862 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,862 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,863 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:36,863 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:36,864 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:36,864 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,865 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:36,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:36,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:36,865 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:36,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:36,866 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:36,866 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:36,866 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:36,866 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:37,289 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010359065b754b9e4b47ab5a758ebeea5cc9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010359065b754b9e4b47ab5a758ebeea5cc9 2023-04-04 17:54:37,698 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/dd82c22b42894ef79343111060f6a629 2023-04-04 17:54:37,711 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/dd82c22b42894ef79343111060f6a629 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/dd82c22b42894ef79343111060f6a629 2023-04-04 17:54:37,718 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/dd82c22b42894ef79343111060f6a629, entries=1, sequenceid=33, filesize=5.0 K 2023-04-04 17:54:37,719 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 853ms, sequenceid=33, compaction requested=true 2023-04-04 17:54:37,719 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:37,719 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:37,719 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:37,719 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:37,719 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,719 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:37,719 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:37,720 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,720 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:37,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:37,721 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,721 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:37,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:37,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:37,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:37,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:37,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66311334[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:37,722 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:37,722 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,723 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,723 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:37,723 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:37,723 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:37,723 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,723 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:37,723 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:37,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:37,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:37,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:37,726 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:37,726 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:37,726 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:37,726 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,726 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:37,727 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,727 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,727 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:37,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:37,727 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,728 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,729 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:37,729 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:37,729 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,729 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:37,729 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:37,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:37,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:37,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:37,729 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:37,730 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,730 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,730 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,730 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,730 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:37,730 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:37,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:37,830 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:37,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:37,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:37,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:37,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,842 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:37,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:37,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:37,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:37,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,843 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,844 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:37,844 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:37,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:37,845 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:37,845 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:37,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:37,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,846 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:37,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:37,846 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:37,846 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:37,847 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:37,847 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:37,847 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:37,847 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:37,847 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:37,847 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:38,267 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077c13ec0301c84be29692be4a811a0cae to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509077c13ec0301c84be29692be4a811a0cae 2023-04-04 17:54:38,674 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/5acf30c8a3f3465186e1cd35acef345e 2023-04-04 17:54:38,685 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/5acf30c8a3f3465186e1cd35acef345e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/5acf30c8a3f3465186e1cd35acef345e 2023-04-04 17:54:38,689 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/5acf30c8a3f3465186e1cd35acef345e, entries=1, sequenceid=37, filesize=5.0 K 2023-04-04 17:54:38,690 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 843ms, sequenceid=37, compaction requested=true 2023-04-04 17:54:38,690 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:38,690 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:38,692 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,692 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:38,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:38,692 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,693 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:38,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:38,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:38,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:38,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:38,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@254516dc[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:38,694 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:38,694 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,695 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:38,695 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,695 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:38,696 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:38,696 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:38,696 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,696 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:38,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:38,700 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:38,700 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:38,700 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:38,700 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,700 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:38,702 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,702 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:38,702 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:38,703 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,704 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,706 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:38,706 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:38,706 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:38,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:38,706 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:38,707 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,707 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,707 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,707 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,707 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:38,707 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:38,707 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:38,707 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:38,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:38,808 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:38,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:38,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:38,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:38,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,815 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:38,815 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:38,815 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-04 17:54:38,815 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-04 17:54:38,816 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,816 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,817 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:38,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:38,818 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:38,818 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,819 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-04 17:54:38,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:38,819 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-04 17:54:38,819 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:38,819 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-04 17:54:38,819 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:54:38,819 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:38,819 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:38,819 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. started... 2023-04-04 17:54:38,820 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f230c29a6626fee30f4fe9a22bda5eb 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:54:39,236 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ec763435deda4b4fac7220949ecc2b54 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120ec763435deda4b4fac7220949ecc2b54 2023-04-04 17:54:39,643 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/f246c0da0e79453d82b479e3329402c3 2023-04-04 17:54:39,651 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/f246c0da0e79453d82b479e3329402c3 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f246c0da0e79453d82b479e3329402c3 2023-04-04 17:54:39,657 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f246c0da0e79453d82b479e3329402c3, entries=1, sequenceid=41, filesize=5.0 K 2023-04-04 17:54:39,659 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2f230c29a6626fee30f4fe9a22bda5eb in 839ms, sequenceid=41, compaction requested=true 2023-04-04 17:54:39,659 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:39,659 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:39,659 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:54:39,659 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:54:39,659 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,659 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-04 17:54:39,659 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-04 17:54:39,661 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,661 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:39,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:39,662 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,662 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:39,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:39,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:39,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-04 17:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31b4f380[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:39,663 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-04 17:54:39,663 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,664 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,664 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-04 17:54:39,664 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-04 17:54:39,664 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:39,664 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,664 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:39,665 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,665 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-04 17:54:39,665 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:39,665 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-04 17:54:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-04 17:54:39,668 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-04 17:54:39,668 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:39,668 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:39,668 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,668 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:39,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:39,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:39,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:39,670 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,671 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:39,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,672 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,672 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,672 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:39,672 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:39,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:39,672 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:39,672 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:39,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-04 17:54:39,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-04 17:54:39,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:39,672 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:39,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:39,673 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,673 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,673 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:39,673 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,673 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:39,773 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:39,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:39,778 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:39,781 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:39,783 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:39,784 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:39,784 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631479784 2023-04-04 17:54:39,785 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:54:39,786 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-04-04 17:54:39,786 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:39,787 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x33112eff to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:39,796 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@429fb9dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:39,796 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,656 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ad0a06a238054c3cbf94488553d16b6b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ad0a06a238054c3cbf94488553d16b6b 2023-04-04 17:54:40,657 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:40,668 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:54:40,669 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:54:40,676 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:54:40,677 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:54:40,686 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6195849b8c4946fd8c1669c4edefa1a2 first=Optional[r3] last=Optional[r6] 2023-04-04 17:54:40,687 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6195849b8c4946fd8c1669c4edefa1a2}] 2023-04-04 17:54:40,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6195849b8c4946fd8c1669c4edefa1a2 for inclusion in 2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:40,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-04 17:54:40,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:40,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:40,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6195849b8c4946fd8c1669c4edefa1a2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__unajl8mndrkut7bktbtus6tuji2eg8qflkou6vu0jrobrald72nqmtgdrnsofpor/family1/6195849b8c4946fd8c1669c4edefa1a2 2023-04-04 17:54:40,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__unajl8mndrkut7bktbtus6tuji2eg8qflkou6vu0jrobrald72nqmtgdrnsofpor/family1/6195849b8c4946fd8c1669c4edefa1a2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_ 2023-04-04 17:54:40,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__unajl8mndrkut7bktbtus6tuji2eg8qflkou6vu0jrobrald72nqmtgdrnsofpor/family1/6195849b8c4946fd8c1669c4edefa1a2 into 2f230c29a6626fee30f4fe9a22bda5eb/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_ - updating store file list. 2023-04-04 17:54:40,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_ into 2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:40,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__unajl8mndrkut7bktbtus6tuji2eg8qflkou6vu0jrobrald72nqmtgdrnsofpor/family1/6195849b8c4946fd8c1669c4edefa1a2 into 2f230c29a6626fee30f4fe9a22bda5eb/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_) 2023-04-04 17:54:40,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__unajl8mndrkut7bktbtus6tuji2eg8qflkou6vu0jrobrald72nqmtgdrnsofpor/family1/6195849b8c4946fd8c1669c4edefa1a2 2023-04-04 17:54:40,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-04 17:54:40,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-04 17:54:40,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): 2f230c29a6626fee30f4fe9a22bda5eb/family1 is initiating minor compaction 2023-04-04 17:54:40,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@67efb59b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:40,704 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2f230c29a6626fee30f4fe9a22bda5eb/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:40,705 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/6bfbbd40c0ea4585bce06d8ee4159936, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/06dfbc6544df4be68ee09cd47a3b23f1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/926ec810a0d644d280c89f8cca29cb45, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/a508e2599f2644cc825509ce6e845408, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7c1ca1b91dd84c65bd49c3b59701cf5f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/8f4e9a9117244f80a10d9beed959ca72, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/dd82c22b42894ef79343111060f6a629, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/5acf30c8a3f3465186e1cd35acef345e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f246c0da0e79453d82b479e3329402c3, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp, totalSize=50.3 K 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 6bfbbd40c0ea4585bce06d8ee4159936, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 06dfbc6544df4be68ee09cd47a3b23f1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 926ec810a0d644d280c89f8cca29cb45, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting a508e2599f2644cc825509ce6e845408, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 7c1ca1b91dd84c65bd49c3b59701cf5f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 8f4e9a9117244f80a10d9beed959ca72, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting dd82c22b42894ef79343111060f6a629, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 5acf30c8a3f3465186e1cd35acef345e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting f246c0da0e79453d82b479e3329402c3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-04 17:54:40,705 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting b3117164d01a4960925573feb94ffe0f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-04 17:54:40,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:40,707 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:40,708 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228310efa8b3b594830bde9b7ce13ef5ba8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228310efa8b3b594830bde9b7ce13ef5ba8 2023-04-04 17:54:40,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311b831a7e550b4d0188ea6e46bb21b4d7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311b831a7e550b4d0188ea6e46bb21b4d7 2023-04-04 17:54:40,710 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f06f08cb3ba5422983a726d4c79544ff to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f06f08cb3ba5422983a726d4c79544ff 2023-04-04 17:54:40,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010359065b754b9e4b47ab5a758ebeea5cc9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010359065b754b9e4b47ab5a758ebeea5cc9 2023-04-04 17:54:40,711 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-04-04 17:54:40,711 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-04 17:54:40,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:40,737 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2f230c29a6626fee30f4fe9a22bda5eb#family1#compaction#73 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-04 17:54:40,756 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:40,757 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64a50e31 to 127.0.0.1:61441 2023-04-04 17:54:40,758 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:40,759 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:40,759 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bf317f2 to 127.0.0.1:61441 2023-04-04 17:54:40,759 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:40,759 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bfe94f5 to 127.0.0.1:61441 2023-04-04 17:54:40,759 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:40,759 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:40,759 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53d95a39 to 127.0.0.1:61441 2023-04-04 17:54:40,759 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:41,580 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/f6ae1cbe1e5d4e76a4a23db617747766 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f6ae1cbe1e5d4e76a4a23db617747766 2023-04-04 17:54:41,584 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205382fbc2f59804f148581e8e0b43ecaa4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205382fbc2f59804f148581e8e0b43ecaa4 2023-04-04 17:54:41,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:41,585 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2f230c29a6626fee30f4fe9a22bda5eb/family1 of 2f230c29a6626fee30f4fe9a22bda5eb into f6ae1cbe1e5d4e76a4a23db617747766(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:54:41,585 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:41,585 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1680630880704; duration=0sec 2023-04-04 17:54:41,585 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:41,606 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1f559aac55d4b4fbdd182fe33b9118b first=Optional[r00] last=Optional[r2] 2023-04-04 17:54:41,607 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1f559aac55d4b4fbdd182fe33b9118b}] 2023-04-04 17:54:41,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1f559aac55d4b4fbdd182fe33b9118b for inclusion in 2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:41,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-04 17:54:41,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:41,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:41,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1f559aac55d4b4fbdd182fe33b9118b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf0nd1ve9cr69s5haf7t9o5t007reuq62rvtpc05b9rj2glrfnpf3fic5kr130o7/family1/b1f559aac55d4b4fbdd182fe33b9118b 2023-04-04 17:54:41,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf0nd1ve9cr69s5haf7t9o5t007reuq62rvtpc05b9rj2glrfnpf3fic5kr130o7/family1/b1f559aac55d4b4fbdd182fe33b9118b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_ 2023-04-04 17:54:41,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf0nd1ve9cr69s5haf7t9o5t007reuq62rvtpc05b9rj2glrfnpf3fic5kr130o7/family1/b1f559aac55d4b4fbdd182fe33b9118b into 2f230c29a6626fee30f4fe9a22bda5eb/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_ - updating store file list. 2023-04-04 17:54:41,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_ into 2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:41,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf0nd1ve9cr69s5haf7t9o5t007reuq62rvtpc05b9rj2glrfnpf3fic5kr130o7/family1/b1f559aac55d4b4fbdd182fe33b9118b into 2f230c29a6626fee30f4fe9a22bda5eb/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_) 2023-04-04 17:54:41,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf0nd1ve9cr69s5haf7t9o5t007reuq62rvtpc05b9rj2glrfnpf3fic5kr130o7/family1/b1f559aac55d4b4fbdd182fe33b9118b 2023-04-04 17:54:41,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:54:41,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:54:41,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): 2f230c29a6626fee30f4fe9a22bda5eb/family1 is initiating minor compaction (all files) 2023-04-04 17:54:41,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3e4e485; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:41,621 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2f230c29a6626fee30f4fe9a22bda5eb/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:41,621 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/edcc172b4ed6465bbda232a1d358b01b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f6ae1cbe1e5d4e76a4a23db617747766, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp, totalSize=388.1 K 2023-04-04 17:54:41,621 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting edcc172b4ed6465bbda232a1d358b01b, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809546 2023-04-04 17:54:41,622 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting f6ae1cbe1e5d4e76a4a23db617747766, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209546 2023-04-04 17:54:41,622 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 9adc049015354d3e9bbde9151e8089b8_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809546 2023-04-04 17:54:41,622 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:41,623 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:41,625 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e7fef150db704ab4b1e8144d2a30206f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e7fef150db704ab4b1e8144d2a30206f 2023-04-04 17:54:41,626 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512013f840ae6c4b84058992cf58a6bedf0f6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512013f840ae6c4b84058992cf58a6bedf0f6 2023-04-04 17:54:41,628 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a40f02374dbe4dae8f7e36d29447662e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a40f02374dbe4dae8f7e36d29447662e 2023-04-04 17:54:41,628 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-04-04 17:54:41,628 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-04 17:54:41,630 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:41,630 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:41,630 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:41,638 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:41,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8590 sec 2023-04-04 17:54:41,656 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2f230c29a6626fee30f4fe9a22bda5eb#family1#compaction#74 average throughput is 10.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-04 17:54:41,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/6bfbbd40c0ea4585bce06d8ee4159936, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/06dfbc6544df4be68ee09cd47a3b23f1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/926ec810a0d644d280c89f8cca29cb45, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/a508e2599f2644cc825509ce6e845408, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7c1ca1b91dd84c65bd49c3b59701cf5f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/8f4e9a9117244f80a10d9beed959ca72, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/dd82c22b42894ef79343111060f6a629, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/5acf30c8a3f3465186e1cd35acef345e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f246c0da0e79453d82b479e3329402c3, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_] to archive 2023-04-04 17:54:41,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:41,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/6bfbbd40c0ea4585bce06d8ee4159936 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/6bfbbd40c0ea4585bce06d8ee4159936 2023-04-04 17:54:41,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/06dfbc6544df4be68ee09cd47a3b23f1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/06dfbc6544df4be68ee09cd47a3b23f1 2023-04-04 17:54:41,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/926ec810a0d644d280c89f8cca29cb45 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/926ec810a0d644d280c89f8cca29cb45 2023-04-04 17:54:41,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/a508e2599f2644cc825509ce6e845408 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/a508e2599f2644cc825509ce6e845408 2023-04-04 17:54:41,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7c1ca1b91dd84c65bd49c3b59701cf5f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7c1ca1b91dd84c65bd49c3b59701cf5f 2023-04-04 17:54:41,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/8f4e9a9117244f80a10d9beed959ca72 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/8f4e9a9117244f80a10d9beed959ca72 2023-04-04 17:54:41,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/dd82c22b42894ef79343111060f6a629 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/dd82c22b42894ef79343111060f6a629 2023-04-04 17:54:41,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/5acf30c8a3f3465186e1cd35acef345e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/5acf30c8a3f3465186e1cd35acef345e 2023-04-04 17:54:41,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f246c0da0e79453d82b479e3329402c3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f246c0da0e79453d82b479e3329402c3 2023-04-04 17:54:41,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/b3117164d01a4960925573feb94ffe0f_SeqId_44_ 2023-04-04 17:54:41,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-04 17:54:41,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:42,146 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-04-04 17:54:42,148 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-04-04 17:54:42,148 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-04-04 17:54:42,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-04-04 17:54:42,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE}] 2023-04-04 17:54:42,158 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE 2023-04-04 17:54:42,159 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:42,159 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630882159"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630882159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630882159"}]},"ts":"1680630882159"} 2023-04-04 17:54:42,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:42,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:42,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2f230c29a6626fee30f4fe9a22bda5eb, disabling compactions & flushes 2023-04-04 17:54:42,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:42,887 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/.tmp/family1/2b61b050d68e4f9fad40290c4cdaf5bb as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/2b61b050d68e4f9fad40290c4cdaf5bb 2023-04-04 17:54:42,892 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2f230c29a6626fee30f4fe9a22bda5eb/family1 of 2f230c29a6626fee30f4fe9a22bda5eb into 2b61b050d68e4f9fad40290c4cdaf5bb(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:54:42,892 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:42,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:42,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:42,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. after waiting 0 ms 2023-04-04 17:54:42,892 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1680630881621; duration=1sec 2023-04-04 17:54:42,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:42,892 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:42,895 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/edcc172b4ed6465bbda232a1d358b01b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f6ae1cbe1e5d4e76a4a23db617747766, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_] to archive 2023-04-04 17:54:42,896 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:42,898 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/edcc172b4ed6465bbda232a1d358b01b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/edcc172b4ed6465bbda232a1d358b01b 2023-04-04 17:54:42,899 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f6ae1cbe1e5d4e76a4a23db617747766 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/f6ae1cbe1e5d4e76a4a23db617747766 2023-04-04 17:54:42,900 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/9adc049015354d3e9bbde9151e8089b8_SeqId_47_ 2023-04-04 17:54:42,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-04 17:54:42,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:42,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:42,906 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 2f230c29a6626fee30f4fe9a22bda5eb to self. 2023-04-04 17:54:42,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:42,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=CLOSED 2023-04-04 17:54:42,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630882908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630882908"}]},"ts":"1680630882908"} 2023-04-04 17:54:42,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-04-04 17:54:42,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259 in 749 msec 2023-04-04 17:54:42,915 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=true 2023-04-04 17:54:43,065 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:43,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630883065"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630883065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630883065"}]},"ts":"1680630883065"} 2023-04-04 17:54:43,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:43,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:43,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f230c29a6626fee30f4fe9a22bda5eb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:54:43,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:43,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:43,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:43,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:43,230 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:43,232 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:43,232 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:43,233 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f230c29a6626fee30f4fe9a22bda5eb columnFamilyName family1 2023-04-04 17:54:43,243 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/2b61b050d68e4f9fad40290c4cdaf5bb 2023-04-04 17:54:43,244 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(310): Store=2f230c29a6626fee30f4fe9a22bda5eb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:43,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:43,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:43,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:43,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2f230c29a6626fee30f4fe9a22bda5eb; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68929452, jitterRate=0.027128875255584717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:54:43,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:43,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., pid=63, masterSystemTime=1680630883220 2023-04-04 17:54:43,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:43,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:43,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:43,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630883258"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630883258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630883258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630883258"}]},"ts":"1680630883258"} 2023-04-04 17:54:43,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-04-04 17:54:43,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259 in 193 msec 2023-04-04 17:54:43,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-04-04 17:54:43,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE in 1.1050 sec 2023-04-04 17:54:43,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-04-04 17:54:43,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1120 sec 2023-04-04 17:54:43,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5330 sec 2023-04-04 17:54:43,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-04-04 17:54:43,270 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(278): alter status finished 2023-04-04 17:54:43,271 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:43,272 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:43,273 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:43,273 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:43,273 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631483273 2023-04-04 17:54:43,274 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:54:43,275 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-04-04 17:54:43,275 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:43,275 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x14e80184 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:43,280 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ef3ddb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:43,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:43,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:43,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:43,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:43,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:44,103 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289aad381f94c64fda8fa2dbf350893a27 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511289aad381f94c64fda8fa2dbf350893a27 2023-04-04 17:54:44,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:44,118 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:54:44,119 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:54:44,125 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:54:44,127 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:54:44,139 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/27ba91b1bad84b7294ff379e57ab6fda first=Optional[r05] last=Optional[r8] 2023-04-04 17:54:44,140 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/27ba91b1bad84b7294ff379e57ab6fda}] 2023-04-04 17:54:44,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/27ba91b1bad84b7294ff379e57ab6fda for inclusion in 2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:44,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-04-04 17:54:44,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:44,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:44,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/27ba91b1bad84b7294ff379e57ab6fda to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lvdq4b1k2c79g1jt1b5l1r4mt432p5u513g7er6qe5o2soeftkjsvsb5lb41n0me/family1/27ba91b1bad84b7294ff379e57ab6fda 2023-04-04 17:54:44,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lvdq4b1k2c79g1jt1b5l1r4mt432p5u513g7er6qe5o2soeftkjsvsb5lb41n0me/family1/27ba91b1bad84b7294ff379e57ab6fda as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7f2225e644684d1da9698eefe75ee197_SeqId_53_ 2023-04-04 17:54:44,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lvdq4b1k2c79g1jt1b5l1r4mt432p5u513g7er6qe5o2soeftkjsvsb5lb41n0me/family1/27ba91b1bad84b7294ff379e57ab6fda into 2f230c29a6626fee30f4fe9a22bda5eb/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7f2225e644684d1da9698eefe75ee197_SeqId_53_ - updating store file list. 2023-04-04 17:54:44,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7f2225e644684d1da9698eefe75ee197_SeqId_53_ into 2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:44,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lvdq4b1k2c79g1jt1b5l1r4mt432p5u513g7er6qe5o2soeftkjsvsb5lb41n0me/family1/27ba91b1bad84b7294ff379e57ab6fda into 2f230c29a6626fee30f4fe9a22bda5eb/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7f2225e644684d1da9698eefe75ee197_SeqId_53_) 2023-04-04 17:54:44,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lvdq4b1k2c79g1jt1b5l1r4mt432p5u513g7er6qe5o2soeftkjsvsb5lb41n0me/family1/27ba91b1bad84b7294ff379e57ab6fda 2023-04-04 17:54:44,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:44,157 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:44,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120ec763435deda4b4fac7220949ecc2b54 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120ec763435deda4b4fac7220949ecc2b54 2023-04-04 17:54:44,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285d0b2fa3a34b484a9ad97f085ad7ad30 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285d0b2fa3a34b484a9ad97f085ad7ad30 2023-04-04 17:54:44,159 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-04-04 17:54:44,159 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-04 17:54:44,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:44,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:44,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:44,160 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:44,160 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:44,161 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:44,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 890 msec 2023-04-04 17:54:44,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$12(2454): Client=jenkins//136.243.18.41 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-04-04 17:54:44,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:44,628 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-04-04 17:54:44,629 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-04-04 17:54:44,630 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-04-04 17:54:44,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-04-04 17:54:44,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE}] 2023-04-04 17:54:44,634 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE 2023-04-04 17:54:44,634 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:44,635 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630884634"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630884634"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630884634"}]},"ts":"1680630884634"} 2023-04-04 17:54:44,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:44,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:44,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2f230c29a6626fee30f4fe9a22bda5eb, disabling compactions & flushes 2023-04-04 17:54:44,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:44,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:44,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. after waiting 0 ms 2023-04-04 17:54:44,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:44,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-04-04 17:54:44,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:44,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:44,793 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 2f230c29a6626fee30f4fe9a22bda5eb to self. 2023-04-04 17:54:44,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:44,795 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=CLOSED 2023-04-04 17:54:44,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630884795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630884795"}]},"ts":"1680630884795"} 2023-04-04 17:54:44,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-04-04 17:54:44,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259 in 160 msec 2023-04-04 17:54:44,799 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=true 2023-04-04 17:54:44,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:44,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630884949"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630884949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630884949"}]},"ts":"1680630884949"} 2023-04-04 17:54:44,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:45,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:45,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f230c29a6626fee30f4fe9a22bda5eb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:54:45,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:45,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:45,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:45,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:45,107 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:45,108 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:45,109 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1 2023-04-04 17:54:45,109 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f230c29a6626fee30f4fe9a22bda5eb columnFamilyName family1 2023-04-04 17:54:45,114 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/2b61b050d68e4f9fad40290c4cdaf5bb 2023-04-04 17:54:45,118 DEBUG [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/family1/7f2225e644684d1da9698eefe75ee197_SeqId_53_ 2023-04-04 17:54:45,118 INFO [StoreOpener-2f230c29a6626fee30f4fe9a22bda5eb-1] regionserver.HStore(310): Store=2f230c29a6626fee30f4fe9a22bda5eb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:45,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:45,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:45,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:54:45,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2f230c29a6626fee30f4fe9a22bda5eb; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61611220, jitterRate=-0.0819212794303894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:54:45,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:54:45,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb., pid=69, masterSystemTime=1680630885103 2023-04-04 17:54:45,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:45,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:54:45,125 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2f230c29a6626fee30f4fe9a22bda5eb, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:45,125 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680630885125"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630885125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630885125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630885125"}]},"ts":"1680630885125"} 2023-04-04 17:54:45,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-04-04 17:54:45,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 2f230c29a6626fee30f4fe9a22bda5eb, server=jenkins-hbase17.apache.org,46251,1680630785259 in 175 msec 2023-04-04 17:54:45,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-04-04 17:54:45,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2f230c29a6626fee30f4fe9a22bda5eb, REOPEN/MOVE in 495 msec 2023-04-04 17:54:45,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-04-04 17:54:45,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 498 msec 2023-04-04 17:54:45,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 913 msec 2023-04-04 17:54:45,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-04-04 17:54:45,134 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(278): alter status finished 2023-04-04 17:54:45,135 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-04 17:54:45,136 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:45,137 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:45,137 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:45,137 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631485137 2023-04-04 17:54:45,138 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:54:45,138 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-04-04 17:54:45,139 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:45,139 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x22782717 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:45,144 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@81ad912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-04 17:54:45,145 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-04 17:54:45,145 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:45,147 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-04 17:54:45,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-04-04 17:54:45,201 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=241 (was 244), OpenFileDescriptor=614 (was 616), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=103 (was 144), ProcessCount=173 (was 174), AvailableMemoryMB=8083 (was 7646) - AvailableMemoryMB LEAK? - 2023-04-04 17:54:45,213 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=241, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=103, ProcessCount=173, AvailableMemoryMB=8083 2023-04-04 17:54:45,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-04 17:54:45,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:45,219 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:54:45,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-04-04 17:54:45,220 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:54:45,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-04 17:54:45,221 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,221 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762 empty. 2023-04-04 17:54:45,222 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,222 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-04-04 17:54:45,229 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-04-04 17:54:45,230 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => db6acc94edcbcbdc3d5d5c7120a8d762, NAME => 'testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:54:45,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-04 17:54:45,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-04 17:54:45,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:45,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing db6acc94edcbcbdc3d5d5c7120a8d762, disabling compactions & flushes 2023-04-04 17:54:45,645 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:45,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:45,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. after waiting 0 ms 2023-04-04 17:54:45,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:45,645 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:45,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for db6acc94edcbcbdc3d5d5c7120a8d762: 2023-04-04 17:54:45,647 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:54:45,648 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680630885648"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630885648"}]},"ts":"1680630885648"} 2023-04-04 17:54:45,650 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:54:45,651 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:54:45,651 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630885651"}]},"ts":"1680630885651"} 2023-04-04 17:54:45,653 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-04-04 17:54:45,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=db6acc94edcbcbdc3d5d5c7120a8d762, ASSIGN}] 2023-04-04 17:54:45,658 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=db6acc94edcbcbdc3d5d5c7120a8d762, ASSIGN 2023-04-04 17:54:45,659 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=db6acc94edcbcbdc3d5d5c7120a8d762, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:54:45,810 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=db6acc94edcbcbdc3d5d5c7120a8d762, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:45,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680630885810"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630885810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630885810"}]},"ts":"1680630885810"} 2023-04-04 17:54:45,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure db6acc94edcbcbdc3d5d5c7120a8d762, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:45,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-04 17:54:45,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:45,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db6acc94edcbcbdc3d5d5c7120a8d762, NAME => 'testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:54:45,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-04-04 17:54:45,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-04-04 17:54:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,973 INFO [StoreOpener-db6acc94edcbcbdc3d5d5c7120a8d762-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,977 DEBUG [StoreOpener-db6acc94edcbcbdc3d5d5c7120a8d762-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1 2023-04-04 17:54:45,977 DEBUG [StoreOpener-db6acc94edcbcbdc3d5d5c7120a8d762-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1 2023-04-04 17:54:45,978 INFO [StoreOpener-db6acc94edcbcbdc3d5d5c7120a8d762-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db6acc94edcbcbdc3d5d5c7120a8d762 columnFamilyName f1 2023-04-04 17:54:45,984 INFO [StoreOpener-db6acc94edcbcbdc3d5d5c7120a8d762-1] regionserver.HStore(310): Store=db6acc94edcbcbdc3d5d5c7120a8d762/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:45,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:45,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:54:45,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened db6acc94edcbcbdc3d5d5c7120a8d762; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61243808, jitterRate=-0.08739614486694336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:54:45,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for db6acc94edcbcbdc3d5d5c7120a8d762: 2023-04-04 17:54:45,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762., pid=73, masterSystemTime=1680630885964 2023-04-04 17:54:45,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:45,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:45,992 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=db6acc94edcbcbdc3d5d5c7120a8d762, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:45,993 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680630885992"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630885992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630885992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630885992"}]},"ts":"1680630885992"} 2023-04-04 17:54:45,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-04-04 17:54:45,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure db6acc94edcbcbdc3d5d5c7120a8d762, server=jenkins-hbase17.apache.org,46251,1680630785259 in 182 msec 2023-04-04 17:54:45,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-04-04 17:54:45,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=db6acc94edcbcbdc3d5d5c7120a8d762, ASSIGN in 340 msec 2023-04-04 17:54:45,997 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:54:45,997 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630885997"}]},"ts":"1680630885997"} 2023-04-04 17:54:45,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-04-04 17:54:46,001 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:54:46,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 785 msec 2023-04-04 17:54:46,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-04 17:54:46,328 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-04-04 17:54:46,328 DEBUG [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-04-04 17:54:46,330 INFO [Listener at localhost.localdomain/45763] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-04-04 17:54:46,334 INFO [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-04-04 17:54:46,335 INFO [Listener at localhost.localdomain/45763] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-04-04 17:54:46,335 INFO [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-04-04 17:54:46,340 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2745): Flushing db6acc94edcbcbdc3d5d5c7120a8d762 1/1 column families, dataSize=37 B heapSize=368 B 2023-04-04 17:54:46,370 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304040ba41ba2507145f1b2d044099006ec98 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304040ba41ba2507145f1b2d044099006ec98 2023-04-04 17:54:46,393 INFO [Listener at localhost.localdomain/45763] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/.tmp/f1/d2a0287ae89042dc8455aaec136baa6c 2023-04-04 17:54:46,419 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/.tmp/f1/d2a0287ae89042dc8455aaec136baa6c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c 2023-04-04 17:54:46,425 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c, entries=1, sequenceid=5, filesize=4.9 K 2023-04-04 17:54:46,426 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for db6acc94edcbcbdc3d5d5c7120a8d762 in 86ms, sequenceid=5, compaction requested=false 2023-04-04 17:54:46,426 DEBUG [Listener at localhost.localdomain/45763] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-04-04 17:54:46,426 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2446): Flush status journal for db6acc94edcbcbdc3d5d5c7120a8d762: 2023-04-04 17:54:46,431 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2745): Flushing db6acc94edcbcbdc3d5d5c7120a8d762 1/1 column families, dataSize=37 B heapSize=368 B 2023-04-04 17:54:46,458 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040402c9abdac6594e898060cc2b7e1c6c3e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023040402c9abdac6594e898060cc2b7e1c6c3e 2023-04-04 17:54:46,473 INFO [Listener at localhost.localdomain/45763] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/.tmp/f1/3ffcc7f90c564238850ead0c2fbecfa2 2023-04-04 17:54:46,485 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/.tmp/f1/3ffcc7f90c564238850ead0c2fbecfa2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2 2023-04-04 17:54:46,490 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2, entries=1, sequenceid=9, filesize=4.9 K 2023-04-04 17:54:46,492 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for db6acc94edcbcbdc3d5d5c7120a8d762 in 61ms, sequenceid=9, compaction requested=false 2023-04-04 17:54:46,492 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2446): Flush status journal for db6acc94edcbcbdc3d5d5c7120a8d762: 2023-04-04 17:54:46,493 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-04-04 17:54:46,495 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-04-04 17:54:46,496 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-04-04 17:54:46,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:46,497 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631486497 2023-04-04 17:54:46,497 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-04 17:54:46,498 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-04-04 17:54:46,498 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-04-04 17:54:46,498 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc03fde to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:46,513 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55ccb5fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:46,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230404 for table='testGetAfterCompaction' and column='f1' 2023-04-04 17:54:46,545 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886473; access_time=1680630886434; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,545 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886392; access_time=1680630886345; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,561 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304043f44f565668a44cbabc3ff55f16e784c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304043f44f565668a44cbabc3ff55f16e784c 2023-04-04 17:54:46,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testGetAfterCompaction' column='f1' 2023-04-04 17:54:46,573 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:54:46,574 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:54:46,580 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:54:46,582 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:54:46,596 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886473; access_time=1680630886434; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,596 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886392; access_time=1680630886345; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,597 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/f1/213f434964ed4f6180d4d5aaf1139c10 first=Optional[r1] last=Optional[r2] 2023-04-04 17:54:46,598 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/f1/213f434964ed4f6180d4d5aaf1139c10}] 2023-04-04 17:54:46,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/f1/213f434964ed4f6180d4d5aaf1139c10 for inclusion in db6acc94edcbcbdc3d5d5c7120a8d762/f1 2023-04-04 17:54:46,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-04-04 17:54:46,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:54:46,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for db6acc94edcbcbdc3d5d5c7120a8d762: 2023-04-04 17:54:46,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/f1/213f434964ed4f6180d4d5aaf1139c10 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testGetAfterCompaction__acfcqm919taq0mgbo9rrtjkj9co0c0u1cddgpsrag5jc4kgaj5j9q7icc94pqrg4/f1/213f434964ed4f6180d4d5aaf1139c10 2023-04-04 17:54:46,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testGetAfterCompaction__acfcqm919taq0mgbo9rrtjkj9co0c0u1cddgpsrag5jc4kgaj5j9q7icc94pqrg4/f1/213f434964ed4f6180d4d5aaf1139c10 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_ 2023-04-04 17:54:46,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testGetAfterCompaction__acfcqm919taq0mgbo9rrtjkj9co0c0u1cddgpsrag5jc4kgaj5j9q7icc94pqrg4/f1/213f434964ed4f6180d4d5aaf1139c10 into db6acc94edcbcbdc3d5d5c7120a8d762/f1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_ - updating store file list. 2023-04-04 17:54:46,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_ into db6acc94edcbcbdc3d5d5c7120a8d762/f1 2023-04-04 17:54:46,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testGetAfterCompaction__acfcqm919taq0mgbo9rrtjkj9co0c0u1cddgpsrag5jc4kgaj5j9q7icc94pqrg4/f1/213f434964ed4f6180d4d5aaf1139c10 into db6acc94edcbcbdc3d5d5c7120a8d762/f1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_) 2023-04-04 17:54:46,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testGetAfterCompaction__acfcqm919taq0mgbo9rrtjkj9co0c0u1cddgpsrag5jc4kgaj5j9q7icc94pqrg4/f1/213f434964ed4f6180d4d5aaf1139c10 2023-04-04 17:54:46,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): db6acc94edcbcbdc3d5d5c7120a8d762/f1 is initiating minor compaction 2023-04-04 17:54:46,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@463cc16a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:46,621 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of db6acc94edcbcbdc3d5d5c7120a8d762/f1 in testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:46,621 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/.tmp, totalSize=10.0 K 2023-04-04 17:54:46,621 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 3ffcc7f90c564238850ead0c2fbecfa2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:54:46,621 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:54:46,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testGetAfterCompaction' column='f1' 2023-04-04 17:54:46,624 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:46,626 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023040402c9abdac6594e898060cc2b7e1c6c3e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023040402c9abdac6594e898060cc2b7e1c6c3e 2023-04-04 17:54:46,627 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304040ba41ba2507145f1b2d044099006ec98 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304040ba41ba2507145f1b2d044099006ec98 2023-04-04 17:54:46,627 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-04-04 17:54:46,627 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230404' 2023-04-04 17:54:46,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230404 for table='testGetAfterCompaction' and column='f1' 2023-04-04 17:54:46,627 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-04-04 17:54:46,627 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:54:46,628 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-04-04 17:54:46,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 135 msec 2023-04-04 17:54:46,633 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): db6acc94edcbcbdc3d5d5c7120a8d762#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-04 17:54:46,647 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886473; access_time=1680630886434; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,647 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680630886556; access_time=1680630886534; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-04 17:54:46,647 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886392; access_time=1680630886345; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,660 DEBUG [Listener at localhost.localdomain/45763] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-04-04 17:54:46,672 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-04-04 17:54:46,673 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46251] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:46,673 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-04-04 17:54:46,673 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-04-04 17:54:46,673 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46251] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-04-04 17:54:46,673 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46251] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. because compaction request was cancelled 2023-04-04 17:54:46,679 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/.tmp/f1/6aeb93cdbf4844c2a75c87d785f1ec90 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6aeb93cdbf4844c2a75c87d785f1ec90 2023-04-04 17:54:46,684 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in db6acc94edcbcbdc3d5d5c7120a8d762/f1 of db6acc94edcbcbdc3d5d5c7120a8d762 into 6aeb93cdbf4844c2a75c87d785f1ec90(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:54:46,684 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for db6acc94edcbcbdc3d5d5c7120a8d762: 2023-04-04 17:54:46,684 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1680630886620; duration=0sec 2023-04-04 17:54:46,684 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:54:46,725 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886473; access_time=1680630886434; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,725 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6aeb93cdbf4844c2a75c87d785f1ec90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680630886673; access_time=1680630886629; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,725 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680630886556; access_time=1680630886534; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-04 17:54:46,725 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886392; access_time=1680630886345; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_] to archive 2023-04-04 17:54:46,780 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886473; access_time=1680630886434; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,780 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6aeb93cdbf4844c2a75c87d785f1ec90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680630886673; access_time=1680630886629; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,780 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680630886556; access_time=1680630886534; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-04 17:54:46,780 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886392; access_time=1680630886345; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:46,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/3ffcc7f90c564238850ead0c2fbecfa2 2023-04-04 17:54:46,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6e262df2a94f4f9f868bfb041f9621b3_SeqId_12_ 2023-04-04 17:54:46,831 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6aeb93cdbf4844c2a75c87d785f1ec90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680630886673; access_time=1680630886629; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,831 INFO [Listener at localhost.localdomain/45763] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680630886392; access_time=1680630886345; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-04 17:54:46,951 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-04-04 17:54:46,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testGetAfterCompaction 2023-04-04 17:54:46,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:46,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630886965"}]},"ts":"1680630886965"} 2023-04-04 17:54:46,967 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-04-04 17:54:46,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-04-04 17:54:46,967 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-04-04 17:54:46,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=db6acc94edcbcbdc3d5d5c7120a8d762, UNASSIGN}] 2023-04-04 17:54:46,970 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=db6acc94edcbcbdc3d5d5c7120a8d762, UNASSIGN 2023-04-04 17:54:46,970 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=db6acc94edcbcbdc3d5d5c7120a8d762, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:46,971 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680630886970"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630886970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630886970"}]},"ts":"1680630886970"} 2023-04-04 17:54:46,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure db6acc94edcbcbdc3d5d5c7120a8d762, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-04-04 17:54:47,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing db6acc94edcbcbdc3d5d5c7120a8d762, disabling compactions & flushes 2023-04-04 17:54:47,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. after waiting 0 ms 2023-04-04 17:54:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:47,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-04-04 17:54:47,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-04-04 17:54:47,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762. 2023-04-04 17:54:47,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for db6acc94edcbcbdc3d5d5c7120a8d762: 2023-04-04 17:54:47,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:47,133 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=db6acc94edcbcbdc3d5d5c7120a8d762, regionState=CLOSED 2023-04-04 17:54:47,133 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680630887133"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630887133"}]},"ts":"1680630887133"} 2023-04-04 17:54:47,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-04-04 17:54:47,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure db6acc94edcbcbdc3d5d5c7120a8d762, server=jenkins-hbase17.apache.org,46251,1680630785259 in 163 msec 2023-04-04 17:54:47,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-04-04 17:54:47,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=db6acc94edcbcbdc3d5d5c7120a8d762, UNASSIGN in 168 msec 2023-04-04 17:54:47,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630887138"}]},"ts":"1680630887138"} 2023-04-04 17:54:47,140 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-04-04 17:54:47,141 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-04-04 17:54:47,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 182 msec 2023-04-04 17:54:47,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-04-04 17:54:47,269 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-04-04 17:54:47,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testGetAfterCompaction 2023-04-04 17:54:47,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:47,282 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:47,284 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:47,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-04-04 17:54:47,286 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:47,289 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1, FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/recovered.edits] 2023-04-04 17:54:47,292 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6aeb93cdbf4844c2a75c87d785f1ec90 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/6aeb93cdbf4844c2a75c87d785f1ec90 2023-04-04 17:54:47,293 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/f1/d2a0287ae89042dc8455aaec136baa6c 2023-04-04 17:54:47,296 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/recovered.edits/15.seqid to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762/recovered.edits/15.seqid 2023-04-04 17:54:47,296 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testGetAfterCompaction/db6acc94edcbcbdc3d5d5c7120a8d762 2023-04-04 17:54:47,296 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-04-04 17:54:47,297 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-04-04 17:54:47,297 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-04-04 17:54:47,301 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304043f44f565668a44cbabc3ff55f16e784c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304043f44f565668a44cbabc3ff55f16e784c 2023-04-04 17:54:47,301 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-04-04 17:54:47,304 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:47,327 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-04-04 17:54:47,330 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-04-04 17:54:47,331 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:47,331 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-04-04 17:54:47,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680630887331"}]},"ts":"9223372036854775807"} 2023-04-04 17:54:47,333 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-04-04 17:54:47,333 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => db6acc94edcbcbdc3d5d5c7120a8d762, NAME => 'testGetAfterCompaction,,1680630885217.db6acc94edcbcbdc3d5d5c7120a8d762.', STARTKEY => '', ENDKEY => ''}] 2023-04-04 17:54:47,333 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-04-04 17:54:47,333 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1680630887333"}]},"ts":"9223372036854775807"} 2023-04-04 17:54:47,335 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-04-04 17:54:47,336 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-04 17:54:47,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 60 msec 2023-04-04 17:54:47,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-04-04 17:54:47,386 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-04-04 17:54:47,401 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=252 (was 241) - Thread LEAK? -, OpenFileDescriptor=623 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=103 (was 103), ProcessCount=173 (was 173), AvailableMemoryMB=7841 (was 8083) 2023-04-04 17:54:47,413 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=252, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=103, ProcessCount=173, AvailableMemoryMB=7840 2023-04-04 17:54:47,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-04 17:54:47,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-04-04 17:54:47,418 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:54:47,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-04-04 17:54:47,419 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:54:47,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-04 17:54:47,421 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,421 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,421 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,422 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156 empty. 2023-04-04 17:54:47,422 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8 empty. 2023-04-04 17:54:47,422 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,422 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,426 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11 empty. 2023-04-04 17:54:47,426 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,427 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-04-04 17:54:47,439 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-04-04 17:54:47,441 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 74a0b5f9ac541529f0620ee3e73b0156, NAME => 'testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:54:47,441 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => a2a935adeee11188aab1d3e9831bfb11, NAME => 'testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:54:47,441 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6ff47725e297ecc75d44b4d159db9af8, NAME => 'testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:54:47,453 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:47,453 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 6ff47725e297ecc75d44b4d159db9af8, disabling compactions & flushes 2023-04-04 17:54:47,453 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:47,453 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:47,453 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. after waiting 0 ms 2023-04-04 17:54:47,453 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:47,453 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:47,454 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:47,453 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:47,455 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 74a0b5f9ac541529f0620ee3e73b0156, disabling compactions & flushes 2023-04-04 17:54:47,455 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:47,455 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:47,455 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. after waiting 0 ms 2023-04-04 17:54:47,455 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:47,455 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:47,455 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:47,460 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:47,461 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing a2a935adeee11188aab1d3e9831bfb11, disabling compactions & flushes 2023-04-04 17:54:47,461 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:47,461 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:47,461 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. after waiting 0 ms 2023-04-04 17:54:47,461 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:47,461 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:47,461 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:47,462 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:54:47,463 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630887463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630887463"}]},"ts":"1680630887463"} 2023-04-04 17:54:47,463 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630887463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630887463"}]},"ts":"1680630887463"} 2023-04-04 17:54:47,463 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630887463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630887463"}]},"ts":"1680630887463"} 2023-04-04 17:54:47,465 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-04 17:54:47,466 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:54:47,466 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630887466"}]},"ts":"1680630887466"} 2023-04-04 17:54:47,467 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-04-04 17:54:47,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN}] 2023-04-04 17:54:47,475 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN 2023-04-04 17:54:47,475 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN 2023-04-04 17:54:47,475 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN 2023-04-04 17:54:47,475 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:54:47,475 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:54:47,476 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:54:47,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-04 17:54:47,628 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=74a0b5f9ac541529f0620ee3e73b0156, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:47,628 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=a2a935adeee11188aab1d3e9831bfb11, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:47,628 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6ff47725e297ecc75d44b4d159db9af8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:47,628 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630887627"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630887627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630887627"}]},"ts":"1680630887627"} 2023-04-04 17:54:47,628 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630887627"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630887627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630887627"}]},"ts":"1680630887627"} 2023-04-04 17:54:47,628 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630887627"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630887627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630887627"}]},"ts":"1680630887627"} 2023-04-04 17:54:47,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 74a0b5f9ac541529f0620ee3e73b0156, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:47,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 6ff47725e297ecc75d44b4d159db9af8, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:47,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure a2a935adeee11188aab1d3e9831bfb11, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:54:47,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-04 17:54:47,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:47,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ff47725e297ecc75d44b4d159db9af8, NAME => 'testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.', STARTKEY => '1', ENDKEY => '2'} 2023-04-04 17:54:47,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:47,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,787 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,789 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:54:47,789 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:54:47,789 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ff47725e297ecc75d44b4d159db9af8 columnFamilyName family1 2023-04-04 17:54:47,790 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(310): Store=6ff47725e297ecc75d44b4d159db9af8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:47,791 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,792 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2 2023-04-04 17:54:47,792 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2 2023-04-04 17:54:47,792 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ff47725e297ecc75d44b4d159db9af8 columnFamilyName family2 2023-04-04 17:54:47,793 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(310): Store=6ff47725e297ecc75d44b4d159db9af8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:47,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:54:47,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:54:47,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:54:47,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 6ff47725e297ecc75d44b4d159db9af8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65358177, jitterRate=-0.026087269186973572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:54:47,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:47,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8., pid=84, masterSystemTime=1680630887782 2023-04-04 17:54:47,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:47,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:47,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:47,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2a935adeee11188aab1d3e9831bfb11, NAME => 'testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.', STARTKEY => '2', ENDKEY => ''} 2023-04-04 17:54:47,801 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6ff47725e297ecc75d44b4d159db9af8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:47,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:47,801 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630887801"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630887801"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630887801"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630887801"}]},"ts":"1680630887801"} 2023-04-04 17:54:47,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,802 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-04-04 17:54:47,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 6ff47725e297ecc75d44b4d159db9af8, server=jenkins-hbase17.apache.org,46251,1680630785259 in 172 msec 2023-04-04 17:54:47,803 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:54:47,803 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:54:47,804 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2a935adeee11188aab1d3e9831bfb11 columnFamilyName family1 2023-04-04 17:54:47,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN in 331 msec 2023-04-04 17:54:47,805 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(310): Store=a2a935adeee11188aab1d3e9831bfb11/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:47,805 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,806 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2 2023-04-04 17:54:47,806 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2 2023-04-04 17:54:47,806 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2a935adeee11188aab1d3e9831bfb11 columnFamilyName family2 2023-04-04 17:54:47,807 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(310): Store=a2a935adeee11188aab1d3e9831bfb11/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:47,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:54:47,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:54:47,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:54:47,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a2a935adeee11188aab1d3e9831bfb11; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64945784, jitterRate=-0.03223240375518799}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:54:47,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:47,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11., pid=85, masterSystemTime=1680630887782 2023-04-04 17:54:47,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:47,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:47,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:47,821 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=a2a935adeee11188aab1d3e9831bfb11, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:47,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 74a0b5f9ac541529f0620ee3e73b0156, NAME => 'testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.', STARTKEY => '', ENDKEY => '1'} 2023-04-04 17:54:47,821 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630887821"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630887821"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630887821"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630887821"}]},"ts":"1680630887821"} 2023-04-04 17:54:47,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:54:47,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,825 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-04-04 17:54:47,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure a2a935adeee11188aab1d3e9831bfb11, server=jenkins-hbase17.apache.org,46251,1680630785259 in 192 msec 2023-04-04 17:54:47,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN in 352 msec 2023-04-04 17:54:47,831 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:54:47,831 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:54:47,831 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a0b5f9ac541529f0620ee3e73b0156 columnFamilyName family1 2023-04-04 17:54:47,832 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(310): Store=74a0b5f9ac541529f0620ee3e73b0156/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:47,832 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,833 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2 2023-04-04 17:54:47,833 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2 2023-04-04 17:54:47,833 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a0b5f9ac541529f0620ee3e73b0156 columnFamilyName family2 2023-04-04 17:54:47,834 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(310): Store=74a0b5f9ac541529f0620ee3e73b0156/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:54:47,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:54:47,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:54:47,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:54:47,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 74a0b5f9ac541529f0620ee3e73b0156; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74750751, jitterRate=0.11387299001216888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:54:47,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:47,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156., pid=83, masterSystemTime=1680630887782 2023-04-04 17:54:47,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:47,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:47,847 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=74a0b5f9ac541529f0620ee3e73b0156, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:47,847 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630887847"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630887847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630887847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630887847"}]},"ts":"1680630887847"} 2023-04-04 17:54:47,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-04-04 17:54:47,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 74a0b5f9ac541529f0620ee3e73b0156, server=jenkins-hbase17.apache.org,46251,1680630785259 in 219 msec 2023-04-04 17:54:47,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-04-04 17:54:47,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN in 377 msec 2023-04-04 17:54:47,854 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:54:47,854 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630887854"}]},"ts":"1680630887854"} 2023-04-04 17:54:47,855 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-04-04 17:54:47,857 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:54:47,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 441 msec 2023-04-04 17:54:48,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-04 17:54:48,023 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-04-04 17:54:48,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:48,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:48,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:48,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:48,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-04 17:54:48,058 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-04 17:54:48,058 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:48,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-04 17:54:48,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-04 17:54:48,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:48,059 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:48,060 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:48,060 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:48,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:48,060 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:48,060 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:48,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:48,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-04 17:54:48,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-04 17:54:48,062 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-04 17:54:48,062 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:48,063 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-04 17:54:48,063 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:48,063 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:48,063 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. started... 2023-04-04 17:54:48,064 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. started... 2023-04-04 17:54:48,066 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:54:48,067 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:48,067 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:48,067 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. started... 2023-04-04 17:54:48,068 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 74a0b5f9ac541529f0620ee3e73b0156 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:54:48,068 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6ff47725e297ecc75d44b4d159db9af8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:54:48,068 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a2a935adeee11188aab1d3e9831bfb11 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:54:48,116 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 2023-04-04 17:54:48,442 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:54:48,507 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a 2023-04-04 17:54:48,515 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/8e39f6631c3a4bada81c47aeb22ddd21 2023-04-04 17:54:48,517 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 2023-04-04 17:54:48,522 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/14ca5735b3714b0abf841c5ca9e0090a 2023-04-04 17:54:48,570 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-04-04 17:54:48,936 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb 2023-04-04 17:54:48,947 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040448789c1ada1648f8bd2f5efe20cf9e2e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023040448789c1ada1648f8bd2f5efe20cf9e2e 2023-04-04 17:54:48,949 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404dba2cd11143d48b38b001379fb126eab to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404dba2cd11143d48b38b001379fb126eab 2023-04-04 17:54:48,951 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040402002228086549e6862f4185db1232d1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040402002228086549e6862f4185db1232d1 2023-04-04 17:54:49,355 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/1748b008902e450ca6f76dd015bbbabc 2023-04-04 17:54:49,355 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/d2419f86ce0c465aadac914d1f568abf 2023-04-04 17:54:49,355 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/5cbf6586996047a38a914b91eeb94ce5 2023-04-04 17:54:49,361 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/8e39f6631c3a4bada81c47aeb22ddd21 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21 2023-04-04 17:54:49,361 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/14ca5735b3714b0abf841c5ca9e0090a as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a 2023-04-04 17:54:49,361 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb 2023-04-04 17:54:49,367 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb, entries=4, sequenceid=5, filesize=5.4 K 2023-04-04 17:54:49,368 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/5cbf6586996047a38a914b91eeb94ce5 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5 2023-04-04 17:54:49,369 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21, entries=4, sequenceid=5, filesize=5.4 K 2023-04-04 17:54:49,369 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a, entries=4, sequenceid=5, filesize=5.4 K 2023-04-04 17:54:49,370 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/d2419f86ce0c465aadac914d1f568abf as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf 2023-04-04 17:54:49,370 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/1748b008902e450ca6f76dd015bbbabc as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc 2023-04-04 17:54:49,373 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:54:49,374 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6ff47725e297ecc75d44b4d159db9af8 in 1306ms, sequenceid=5, compaction requested=false 2023-04-04 17:54:49,375 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:49,376 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:49,376 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:54:49,376 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:54:49,377 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a2a935adeee11188aab1d3e9831bfb11 in 1309ms, sequenceid=5, compaction requested=false 2023-04-04 17:54:49,377 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:49,377 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:54:49,377 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:49,378 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:54:49,378 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 74a0b5f9ac541529f0620ee3e73b0156 in 1310ms, sequenceid=5, compaction requested=false 2023-04-04 17:54:49,378 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:49,378 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:49,378 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:54:49,378 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:54:49,378 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,378 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-04 17:54:49,378 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-04 17:54:49,379 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,379 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:49,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:49,380 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,380 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:49,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:49,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:49,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:49,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:49,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-04 17:54:49,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3df649c4[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:49,381 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-04 17:54:49,381 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,382 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-04 17:54:49,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-04 17:54:49,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:49,382 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,382 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:49,383 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:49,383 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-04 17:54:49,383 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:49,383 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-04 17:54:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:49,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-04 17:54:49,385 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-04 17:54:49,385 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:49,385 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:49,385 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-04 17:54:49,385 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:49,386 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:49,386 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,387 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:49,387 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:49,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:49,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:49,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:49,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:49,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,387 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:49,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:49,389 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:49,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:49,389 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:49,389 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:49,389 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-04 17:54:49,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:49,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:49,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:49,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:49,390 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,490 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:49,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:49,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:49,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:49,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:49,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:49,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:49,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-04 17:54:49,497 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-04 17:54:49,497 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:49,498 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-04 17:54:49,498 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-04 17:54:49,498 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,498 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:49,499 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,499 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:49,499 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:49,506 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:49,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:49,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:49,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-04 17:54:49,507 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-04-04 17:54:49,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-04 17:54:49,508 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-04 17:54:49,508 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:49,508 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-04 17:54:49,512 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:49,512 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. started... 2023-04-04 17:54:49,512 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6ff47725e297ecc75d44b4d159db9af8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:54:49,512 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:49,512 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:54:49,512 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:49,512 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:49,512 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. started... 2023-04-04 17:54:49,512 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. started... 2023-04-04 17:54:49,513 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a2a935adeee11188aab1d3e9831bfb11 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:54:49,513 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 74a0b5f9ac541529f0620ee3e73b0156 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:54:49,951 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 2023-04-04 17:54:49,951 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 2023-04-04 17:54:49,954 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a 2023-04-04 17:54:49,958 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/475e3d7fe9824c9eb210cdfcce6452ac 2023-04-04 17:54:49,958 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/8cacce2752c642e19b04e52251f66f09 2023-04-04 17:54:49,966 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/45174dda5ce14291987f01d60113f3c8 2023-04-04 17:54:50,380 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404e20f4064454640e4bcf6d7c368468677 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404e20f4064454640e4bcf6d7c368468677 2023-04-04 17:54:50,380 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304046633bf1bc3d94650a78ed09cfdebce9b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304046633bf1bc3d94650a78ed09cfdebce9b 2023-04-04 17:54:50,383 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304048d2de19a8c4e48b5951af8643316a641 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304048d2de19a8c4e48b5951af8643316a641 2023-04-04 17:54:50,392 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/60c38c3347d444ba83850f4b1e43a5aa 2023-04-04 17:54:50,396 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/45174dda5ce14291987f01d60113f3c8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8 2023-04-04 17:54:50,399 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8, entries=4, sequenceid=9, filesize=5.4 K 2023-04-04 17:54:50,400 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/60c38c3347d444ba83850f4b1e43a5aa as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa 2023-04-04 17:54:50,403 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:54:50,403 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a2a935adeee11188aab1d3e9831bfb11 in 890ms, sequenceid=9, compaction requested=false 2023-04-04 17:54:50,404 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:50,404 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:50,404 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:54:50,786 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/45d38c8f13f44763a8b747a17457d570 2023-04-04 17:54:50,788 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/40d9ed85cd1645acb38412ab48403ca0 2023-04-04 17:54:50,793 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/475e3d7fe9824c9eb210cdfcce6452ac as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac 2023-04-04 17:54:50,794 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/8cacce2752c642e19b04e52251f66f09 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09 2023-04-04 17:54:50,799 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac, entries=4, sequenceid=9, filesize=5.4 K 2023-04-04 17:54:50,799 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09, entries=4, sequenceid=9, filesize=5.4 K 2023-04-04 17:54:50,800 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/45d38c8f13f44763a8b747a17457d570 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570 2023-04-04 17:54:50,800 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/40d9ed85cd1645acb38412ab48403ca0 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0 2023-04-04 17:54:50,805 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:54:50,805 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:54:50,806 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6ff47725e297ecc75d44b4d159db9af8 in 1294ms, sequenceid=9, compaction requested=false 2023-04-04 17:54:50,806 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 74a0b5f9ac541529f0620ee3e73b0156 in 1293ms, sequenceid=9, compaction requested=false 2023-04-04 17:54:50,806 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:50,806 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:50,806 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:50,806 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:50,806 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:54:50,806 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:54:50,806 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:54:50,806 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,806 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-04 17:54:50,806 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-04 17:54:50,807 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,807 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:50,807 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,807 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:50,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-04 17:54:50,808 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-04 17:54:50,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53b045fd[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:50,808 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,809 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,809 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-04 17:54:50,809 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-04 17:54:50,809 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,809 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:50,809 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:50,810 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-04 17:54:50,810 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,810 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,810 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-04 17:54:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:50,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-04 17:54:50,812 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-04 17:54:50,812 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:50,812 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:50,812 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-04 17:54:50,812 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:50,813 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,813 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:50,813 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,814 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:50,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:50,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:50,815 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,816 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:50,816 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:50,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:50,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:50,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:50,817 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:50,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:50,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:50,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-04 17:54:50,917 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:50,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:50,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:50,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:50,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:50,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:50,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:50,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-04 17:54:50,924 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-04 17:54:50,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:50,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-04 17:54:50,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-04 17:54:50,924 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:50,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,925 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:50,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:50,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:50,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:50,925 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:50,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:50,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:50,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:50,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:50,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-04 17:54:50,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-04-04 17:54:50,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-04 17:54:50,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-04 17:54:50,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:50,926 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-04 17:54:50,931 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:50,931 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. started... 2023-04-04 17:54:50,931 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:50,931 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6ff47725e297ecc75d44b4d159db9af8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:54:50,931 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:54:50,931 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:50,931 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:50,931 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. started... 2023-04-04 17:54:50,932 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. started... 2023-04-04 17:54:50,932 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 74a0b5f9ac541529f0620ee3e73b0156 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:54:50,932 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a2a935adeee11188aab1d3e9831bfb11 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:54:50,965 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 2023-04-04 17:54:50,967 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 2023-04-04 17:54:51,355 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a 2023-04-04 17:54:51,380 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/f5f147bf268b4b3290dcbe1dc8b5fab6 2023-04-04 17:54:51,380 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/b6e0163fc14148869c6ccae015583e55 2023-04-04 17:54:51,760 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/f535099c21134b7ea2c2a8ce3df5d654 2023-04-04 17:54:51,793 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304046cec317e139c414ba7726616b670b82c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304046cec317e139c414ba7726616b670b82c 2023-04-04 17:54:51,793 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304047ef0523619fd4eab90fa81c17f5fa636 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304047ef0523619fd4eab90fa81c17f5fa636 2023-04-04 17:54:52,175 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304049ff063b6b3664893ac264ae0b45d8f40 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304049ff063b6b3664893ac264ae0b45d8f40 2023-04-04 17:54:52,202 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/07a91df8b4184ce4926ec30a4bcf22b0 2023-04-04 17:54:52,203 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/905da60919a64529ab99e2d888482cfb 2023-04-04 17:54:52,207 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/b6e0163fc14148869c6ccae015583e55 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55 2023-04-04 17:54:52,207 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/f5f147bf268b4b3290dcbe1dc8b5fab6 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6 2023-04-04 17:54:52,210 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6, entries=4, sequenceid=13, filesize=5.4 K 2023-04-04 17:54:52,210 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55, entries=4, sequenceid=13, filesize=5.4 K 2023-04-04 17:54:52,211 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/07a91df8b4184ce4926ec30a4bcf22b0 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0 2023-04-04 17:54:52,211 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/905da60919a64529ab99e2d888482cfb as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb 2023-04-04 17:54:52,214 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:54:52,214 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:54:52,215 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a2a935adeee11188aab1d3e9831bfb11 in 1283ms, sequenceid=13, compaction requested=true 2023-04-04 17:54:52,215 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 74a0b5f9ac541529f0620ee3e73b0156 in 1283ms, sequenceid=13, compaction requested=true 2023-04-04 17:54:52,215 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:52,215 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:52,215 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:52,215 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:52,215 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:54:52,216 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:54:52,580 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/9353233eda0e4195b7b11c338329f5b7 2023-04-04 17:54:52,585 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/f535099c21134b7ea2c2a8ce3df5d654 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654 2023-04-04 17:54:52,589 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654, entries=4, sequenceid=13, filesize=5.4 K 2023-04-04 17:54:52,589 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/9353233eda0e4195b7b11c338329f5b7 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7 2023-04-04 17:54:52,594 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:54:52,595 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6ff47725e297ecc75d44b4d159db9af8 in 1664ms, sequenceid=13, compaction requested=true 2023-04-04 17:54:52,595 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:52,595 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:52,595 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:54:52,595 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:54:52,595 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,595 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-04 17:54:52,595 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-04 17:54:52,596 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:52,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:52,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:52,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-04 17:54:52,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e4e4aa1[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:52,597 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-04 17:54:52,597 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,598 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,598 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,598 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:52,598 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-04 17:54:52,598 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-04 17:54:52,598 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:52,600 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,600 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-04 17:54:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:52,600 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:52,600 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-04 17:54:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:52,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:52,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:52,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:52,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-04 17:54:52,602 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-04 17:54:52,602 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:52,602 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:52,602 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-04 17:54:52,602 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:52,603 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,603 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:52,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,603 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:52,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:52,603 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:52,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:52,606 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:52,607 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,607 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:52,607 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:52,607 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:52,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-04 17:54:52,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:52,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:52,607 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:52,607 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:52,607 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,608 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,608 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:52,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-04 17:54:52,608 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:52,608 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:52,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:52,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:52,608 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,708 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:52,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:52,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:52,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:52,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:54:52,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:52,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:52,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-04 17:54:52,715 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-04 17:54:52,715 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:52,715 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-04 17:54:52,715 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-04 17:54:52,715 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,715 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:52,716 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,716 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:52,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:52,716 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:52,716 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:52,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:52,717 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-04 17:54:52,717 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-04-04 17:54:52,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-04 17:54:52,717 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-04 17:54:52,717 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:52,717 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-04 17:54:52,718 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:52,718 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. started... 2023-04-04 17:54:52,718 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:52,718 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. started... 2023-04-04 17:54:52,718 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6ff47725e297ecc75d44b4d159db9af8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:54:52,718 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 74a0b5f9ac541529f0620ee3e73b0156 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:54:52,726 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:54:52,726 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:52,726 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:52,726 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. started... 2023-04-04 17:54:52,726 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a2a935adeee11188aab1d3e9831bfb11 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:54:53,156 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 2023-04-04 17:54:53,157 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 2023-04-04 17:54:53,157 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 2023-04-04 17:54:53,323 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:54:53,577 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/5873d4df722e453592e4dc912c68dc37 2023-04-04 17:54:53,579 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/9a57cfb9ec4c4a21a7c494f71987a889 2023-04-04 17:54:53,580 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/c70a58d56195450ab099353e6d710155 2023-04-04 17:54:53,995 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404b76c96b871d7404b832e5a0b22d46ef8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404b76c96b871d7404b832e5a0b22d46ef8 2023-04-04 17:54:53,999 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304043b8e54835cdf491da80e0aa10fa61fe0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304043b8e54835cdf491da80e0aa10fa61fe0 2023-04-04 17:54:54,000 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/95922578f8184b82bfea32731ccbfe2e 2023-04-04 17:54:54,003 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404bc842dac2e464acd9f66dfd926285e69 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404bc842dac2e464acd9f66dfd926285e69 2023-04-04 17:54:54,006 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/5873d4df722e453592e4dc912c68dc37 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37 2023-04-04 17:54:54,009 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37, entries=4, sequenceid=17, filesize=5.4 K 2023-04-04 17:54:54,010 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/95922578f8184b82bfea32731ccbfe2e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e 2023-04-04 17:54:54,013 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:54:54,014 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6ff47725e297ecc75d44b4d159db9af8 in 1296ms, sequenceid=17, compaction requested=true 2023-04-04 17:54:54,014 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:54,014 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:54,014 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:54:54,407 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/8e900dada18a42c3a6a71dbc6a3a79ad 2023-04-04 17:54:54,409 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/73c1df600ff14b9a9a9f9effe69c3316 2023-04-04 17:54:54,411 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/9a57cfb9ec4c4a21a7c494f71987a889 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889 2023-04-04 17:54:54,413 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/c70a58d56195450ab099353e6d710155 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155 2023-04-04 17:54:54,415 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889, entries=4, sequenceid=17, filesize=5.4 K 2023-04-04 17:54:54,415 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/8e900dada18a42c3a6a71dbc6a3a79ad as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad 2023-04-04 17:54:54,418 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155, entries=4, sequenceid=17, filesize=5.4 K 2023-04-04 17:54:54,420 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/73c1df600ff14b9a9a9f9effe69c3316 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316 2023-04-04 17:54:54,422 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:54:54,423 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 74a0b5f9ac541529f0620ee3e73b0156 in 1705ms, sequenceid=17, compaction requested=true 2023-04-04 17:54:54,423 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:54,423 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:54,423 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:54:54,432 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:54:54,433 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a2a935adeee11188aab1d3e9831bfb11 in 1707ms, sequenceid=17, compaction requested=true 2023-04-04 17:54:54,433 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:54,433 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:54:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:54:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-04 17:54:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-04 17:54:54,434 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,434 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:54,434 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,434 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-04 17:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48709a1b[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:54,435 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-04 17:54:54,435 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,436 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,436 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-04 17:54:54,436 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-04 17:54:54,436 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:54,436 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,436 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:54,437 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,437 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-04 17:54:54,437 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:54,437 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-04 17:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:54,439 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-04 17:54:54,439 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:54,439 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:54,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-04 17:54:54,439 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-04 17:54:54,439 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:54,439 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:54,439 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:54,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:54,440 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:54,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:54,440 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:54,441 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:54,442 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:54,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:54,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-04 17:54:54,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:54,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:54,442 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:54,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:54,443 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:54,543 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:54,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:54,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1580): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-04 17:54:54,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1680630894567 (current time:1680630894567). 2023-04-04 17:54:54,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-04-04 17:54:54,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] zookeeper.ReadOnlyZKClient(139): Connect 0x6a818972 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:54:54,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74a3b3c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:54:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:54:54,596 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:54:54,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a818972 to 127.0.0.1:61441 2023-04-04 17:54:54,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:54,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-04-04 17:54:54,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-04 17:54:54,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-04 17:54:54,607 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-04 17:54:54,608 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1680631494608 2023-04-04 17:54:54,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-04 17:54:54,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1680630894544 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-04-04 17:54:54,614 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:54,614 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-04-04 17:54:54,625 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-04 17:54:54,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 20 msec 2023-04-04 17:54:54,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-04-04 17:54:54,628 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-04-04 17:54:54,628 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1680631494628 2023-04-04 17:54:54,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1680630894544 2023-04-04 17:54:54,658 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1680630894544' 2023-04-04 17:54:54,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-04-04 17:54:54,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1680630894544' starting 'acquire' 2023-04-04 17:54:54,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1680630894544', kicking off acquire phase on members. 2023-04-04 17:54:54,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:54,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1680630894544 2023-04-04 17:54:54,660 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-04-04 17:54:54,660 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-04-04 17:54:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-04-04 17:54:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1680630894544 2023-04-04 17:54:54,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-04-04 17:54:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1680630894544 2023-04-04 17:54:54,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1680630894544 from table testCompactionWithHFileLink type FLUSH 2023-04-04 17:54:54,662 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,663 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1680630894544 2023-04-04 17:54:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1680630894544' with timeout 300000ms 2023-04-04 17:54:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-04-04 17:54:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1680630894544' starting 'acquire' stage 2023-04-04 17:54:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1680630894544' locally acquired 2023-04-04 17:54:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (snaptb-1680630894544) in zk 2023-04-04 17:54:54,668 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,668 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-04-04 17:54:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680630894544 2023-04-04 17:54:54,669 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:54,669 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1680630894544' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:54,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'snaptb-1680630894544' on coordinator 2023-04-04 17:54:54,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47c742b8[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:54,670 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1680630894544' starting 'in-barrier' execution. 2023-04-04 17:54:54,670 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:54,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:54,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:54,671 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1680630894544' received 'reached' from coordinator. 2023-04-04 17:54:54,671 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:54,671 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:54,672 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:54,672 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. started... 2023-04-04 17:54:54,672 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:54,673 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.' region-info for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,678 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-04-04 17:54:54,685 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:54,685 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. started... 2023-04-04 17:54:54,685 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:54,685 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.' region-info for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,685 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-04-04 17:54:54,686 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-04-04 17:54:54,686 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-04-04 17:54:54,686 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:54,904 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. started... 2023-04-04 17:54:54,903 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889] hfiles 2023-04-04 17:54:54,904 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,904 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-04-04 17:54:54,903 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37] hfiles 2023-04-04 17:54:54,904 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,903 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22782717 to 127.0.0.1:61441 2023-04-04 17:54:54,903 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:54:54,905 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:54,904 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:54,905 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:54,905 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc03fde to 127.0.0.1:61441 2023-04-04 17:54:54,905 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:54,905 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.' region-info for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,905 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-04-04 17:54:54,905 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155] hfiles 2023-04-04 17:54:54,905 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,905 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:54,905 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14e80184 to 127.0.0.1:61441 2023-04-04 17:54:54,906 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:54,906 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:54:54,906 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33112eff to 127.0.0.1:61441 2023-04-04 17:54:54,906 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:54:54,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:54:54,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,910 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad] hfiles 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316] hfiles 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e] hfiles 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,911 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,912 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,912 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7 for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,912 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e for snapshot=snaptb-1680630894544 2023-04-04 17:54:54,986 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. completed. 2023-04-04 17:54:54,986 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:54,987 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-04-04 17:54:55,111 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:54:55,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:54:55,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:54:55,112 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-04-04 17:54:55,382 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. completed. 2023-04-04 17:54:55,382 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:55,382 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-04-04 17:54:55,384 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. completed. 2023-04-04 17:54:55,384 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:55,384 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-04-04 17:54:55,384 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-04-04 17:54:55,384 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,384 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1680630894544' locally completed 2023-04-04 17:54:55,384 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1680630894544' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:55,385 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1680630894544' has notified controller of completion 2023-04-04 17:54:55,385 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:55,385 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,385 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1680630894544' completed. 2023-04-04 17:54:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-04-04 17:54:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680630894544 2023-04-04 17:54:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680630894544 2023-04-04 17:54:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1680630894544' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:55,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'snaptb-1680630894544', counting down latch. Waiting for 0 more 2023-04-04 17:54:55,387 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1680630894544' execution completed 2023-04-04 17:54:55,388 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:55,388 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:55,388 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1680630894544 2023-04-04 17:54:55,388 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1680630894544including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-04-04 17:54:55,388 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:55,388 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:55,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:55,388 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-04-04 17:54:55,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:55,389 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680630894544 2023-04-04 17:54:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680630894544 2023-04-04 17:54:55,390 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:55,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680630894544 2023-04-04 17:54:55,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,391 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-04-04 17:54:55,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-04-04 17:54:55,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-04-04 17:54:55,391 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-04-04 17:54:55,392 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:55,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1680630894544 2023-04-04 17:54:55,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1680630894544 because node does not exist (not an error) 2023-04-04 17:54:55,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-04-04 17:54:55,392 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-04-04 17:54:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-04-04 17:54:55,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1680630894544 2023-04-04 17:54:55,392 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680630894544 2023-04-04 17:54:55,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-04-04 17:54:55,392 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680630894544 2023-04-04 17:54:55,392 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680630894544/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:55,392 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:55,392 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680630894544 2023-04-04 17:54:55,392 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680630894544 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43] mob files 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 2023-04-04 17:54:55,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 2023-04-04 17:54:55,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a 2023-04-04 17:54:55,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 2023-04-04 17:54:55,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a 2023-04-04 17:54:55,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 2023-04-04 17:54:55,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304046633bf1bc3d94650a78ed09cfdebce9b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304049ff063b6b3664893ac264ae0b45d8f40, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404b76c96b871d7404b832e5a0b22d46ef8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404dba2cd11143d48b38b001379fb126eab, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040402002228086549e6862f4185db1232d1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304046cec317e139c414ba7726616b670b82c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304048d2de19a8c4e48b5951af8643316a641, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404bc842dac2e464acd9f66dfd926285e69, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304043b8e54835cdf491da80e0aa10fa61fe0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023040448789c1ada1648f8bd2f5efe20cf9e2e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304047ef0523619fd4eab90fa81c17f5fa636, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404e20f4064454640e4bcf6d7c368468677] mob files 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304046633bf1bc3d94650a78ed09cfdebce9b 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304049ff063b6b3664893ac264ae0b45d8f40 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404b76c96b871d7404b832e5a0b22d46ef8 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404dba2cd11143d48b38b001379fb126eab 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040402002228086549e6862f4185db1232d1 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304046cec317e139c414ba7726616b670b82c 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304048d2de19a8c4e48b5951af8643316a641 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404bc842dac2e464acd9f66dfd926285e69 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304043b8e54835cdf491da80e0aa10fa61fe0 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023040448789c1ada1648f8bd2f5efe20cf9e2e 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304047ef0523619fd4eab90fa81c17f5fa636 2023-04-04 17:54:55,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404e20f4064454640e4bcf6d7c368468677 2023-04-04 17:54:55,412 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:54:55,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:54:55,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:54:55,413 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-04-04 17:54:55,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1680630894544 2023-04-04 17:54:55,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/snaptb-1680630894544 2023-04-04 17:54:55,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/snaptb-1680630894544 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/snaptb-1680630894544 2023-04-04 17:54:55,913 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:54:55,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:54:55,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:54:55,914 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-04-04 17:54:56,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1680630894544 of table testCompactionWithHFileLink completed 2023-04-04 17:54:56,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/snaptb-1680630894544 2023-04-04 17:54:56,430 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/snaptb-1680630894544 2023-04-04 17:54:56,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1680630894544 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1680630894611Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1680630895414 (+803 ms)Consolidate snapshot: snaptb-1680630894544 at 1680630895414Loading Region manifests for snaptb-1680630894544 at 1680630895414Writing data manifest for snaptb-1680630894544 at 1680630895461 (+47 ms)Verifying snapshot: snaptb-1680630894544 at 1680630895520 (+59 ms)Snapshot snaptb-1680630894544 of table testCompactionWithHFileLink completed at 1680630896429 (+909 ms) 2023-04-04 17:54:56,431 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-04-04 17:54:56,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.8040 sec 2023-04-04 17:54:56,914 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:54:56,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:54:56,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-04-04 17:54:56,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:54:56,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-04 17:54:56,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-04 17:54:56,958 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-04 17:54:56,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:56,958 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-04 17:54:56,959 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-04 17:54:56,959 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:56,959 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:56,960 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:56,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:56,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:56,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:56,960 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:54:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:56,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:54:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:56,961 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-04 17:54:56,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-04 17:54:56,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-04 17:54:56,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:54:56,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-04 17:54:56,965 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:56,965 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. started... 2023-04-04 17:54:56,965 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6ff47725e297ecc75d44b4d159db9af8 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:54:56,966 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:56,966 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. started... 2023-04-04 17:54:56,966 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 74a0b5f9ac541529f0620ee3e73b0156 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:54:56,966 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:54:56,966 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:54:56,966 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:56,966 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. started... 2023-04-04 17:54:56,966 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a2a935adeee11188aab1d3e9831bfb11 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:54:57,392 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/ae821fda627242d9bbe3b6cb6e961b4b 2023-04-04 17:54:57,396 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae821fda627242d9bbe3b6cb6e961b4b 2023-04-04 17:54:57,794 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/2a59216d676e42a4a44b195e14ec58b7 2023-04-04 17:54:57,796 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/43016a587f2d4a5da0248f357c2e2b0c 2023-04-04 17:54:57,798 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a59216d676e42a4a44b195e14ec58b7 2023-04-04 17:54:57,803 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43016a587f2d4a5da0248f357c2e2b0c 2023-04-04 17:54:57,806 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/68657a937d4640aab8b5019f4b736893 2023-04-04 17:54:57,813 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68657a937d4640aab8b5019f4b736893 2023-04-04 17:54:57,814 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/ae821fda627242d9bbe3b6cb6e961b4b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/ae821fda627242d9bbe3b6cb6e961b4b 2023-04-04 17:54:57,818 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae821fda627242d9bbe3b6cb6e961b4b 2023-04-04 17:54:57,818 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/ae821fda627242d9bbe3b6cb6e961b4b, entries=3, sequenceid=24, filesize=5.0 K 2023-04-04 17:54:57,819 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/68657a937d4640aab8b5019f4b736893 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/68657a937d4640aab8b5019f4b736893 2023-04-04 17:54:57,822 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68657a937d4640aab8b5019f4b736893 2023-04-04 17:54:57,823 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/68657a937d4640aab8b5019f4b736893, entries=1, sequenceid=24, filesize=5.0 K 2023-04-04 17:54:57,823 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6ff47725e297ecc75d44b4d159db9af8 in 858ms, sequenceid=24, compaction requested=true 2023-04-04 17:54:57,823 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:57,823 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:57,823 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:54:57,836 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/b9692a9f088443fea9443776b0fafc29 2023-04-04 17:54:57,840 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9692a9f088443fea9443776b0fafc29 2023-04-04 17:54:57,841 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/43016a587f2d4a5da0248f357c2e2b0c as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/43016a587f2d4a5da0248f357c2e2b0c 2023-04-04 17:54:57,845 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43016a587f2d4a5da0248f357c2e2b0c 2023-04-04 17:54:57,845 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/43016a587f2d4a5da0248f357c2e2b0c, entries=3, sequenceid=24, filesize=5.0 K 2023-04-04 17:54:57,846 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/b9692a9f088443fea9443776b0fafc29 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/b9692a9f088443fea9443776b0fafc29 2023-04-04 17:54:57,849 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9692a9f088443fea9443776b0fafc29 2023-04-04 17:54:57,850 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/b9692a9f088443fea9443776b0fafc29, entries=1, sequenceid=24, filesize=5.0 K 2023-04-04 17:54:57,850 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 74a0b5f9ac541529f0620ee3e73b0156 in 884ms, sequenceid=24, compaction requested=true 2023-04-04 17:54:57,851 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:54:57,851 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:57,851 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:54:58,626 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/afc4817502714463987cddfd409cdd00 2023-04-04 17:54:58,630 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afc4817502714463987cddfd409cdd00 2023-04-04 17:54:58,631 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/2a59216d676e42a4a44b195e14ec58b7 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/2a59216d676e42a4a44b195e14ec58b7 2023-04-04 17:54:58,634 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a59216d676e42a4a44b195e14ec58b7 2023-04-04 17:54:58,634 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/2a59216d676e42a4a44b195e14ec58b7, entries=3, sequenceid=24, filesize=5.0 K 2023-04-04 17:54:58,635 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/afc4817502714463987cddfd409cdd00 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/afc4817502714463987cddfd409cdd00 2023-04-04 17:54:58,639 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afc4817502714463987cddfd409cdd00 2023-04-04 17:54:58,639 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/afc4817502714463987cddfd409cdd00, entries=1, sequenceid=24, filesize=5.0 K 2023-04-04 17:54:58,640 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a2a935adeee11188aab1d3e9831bfb11 in 1674ms, sequenceid=24, compaction requested=true 2023-04-04 17:54:58,640 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:54:58,640 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:54:58,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:54:58,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:54:58,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-04 17:54:58,640 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-04 17:54:58,643 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,643 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:58,643 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,643 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:54:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:58,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-04 17:54:58,645 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-04 17:54:58,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16897810[Count = 0] remaining members to acquire global barrier 2023-04-04 17:54:58,645 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,645 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,645 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-04 17:54:58,645 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-04 17:54:58,646 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:54:58,646 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,646 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:54:58,646 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,646 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-04 17:54:58,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:58,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:58,646 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:58,647 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-04 17:54:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:54:58,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-04 17:54:58,648 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-04 17:54:58,649 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:54:58,649 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:54:58,649 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-04 17:54:58,649 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:54:58,650 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:58,650 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:58,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:58,650 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:54:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:54:58,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:54:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:58,651 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:54:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:54:58,654 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-04 17:54:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:54:58,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:54:58,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:54:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:54:58,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-04 17:54:58,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:54:58,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:54:58,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-04 17:54:58,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:54:58,669 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-04 17:54:58,670 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:54:58,770 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:54:58,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:54:58,772 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:54:58,772 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 6ff47725e297ecc75d44b4d159db9af8/family1 is initiating major compaction (all files) 2023-04-04 17:54:58,772 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:54:58,772 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:54:58,773 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 6ff47725e297ecc75d44b4d159db9af8/family1 in testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:58,773 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/ae821fda627242d9bbe3b6cb6e961b4b] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp, totalSize=26.7 K 2023-04-04 17:54:58,773 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting f78ee851ef1b4aff997b9f5e9a0ee1fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888032 2023-04-04 17:54:58,774 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 475e3d7fe9824c9eb210cdfcce6452ac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:54:58,774 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting f535099c21134b7ea2c2a8ce3df5d654, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:54:58,774 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 5873d4df722e453592e4dc912c68dc37, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:54:58,775 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting ae821fda627242d9bbe3b6cb6e961b4b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-04 17:54:58,806 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 6ff47725e297ecc75d44b4d159db9af8#family1#compaction#108 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:54:58,825 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230404e55a7c74e5cf4612ba0e197983baa3ba_del 2023-04-04 17:54:58,825 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404e55a7c74e5cf4612ba0e197983baa3ba_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404e55a7c74e5cf4612ba0e197983baa3ba_del 2023-04-04 17:54:59,252 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08c5f498f34a4635b6cbaa91838ac3fe 2023-04-04 17:54:59,252 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/08c5f498f34a4635b6cbaa91838ac3fe as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/08c5f498f34a4635b6cbaa91838ac3fe 2023-04-04 17:54:59,256 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08c5f498f34a4635b6cbaa91838ac3fe 2023-04-04 17:54:59,257 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6ff47725e297ecc75d44b4d159db9af8/family1 of 6ff47725e297ecc75d44b4d159db9af8 into 08c5f498f34a4635b6cbaa91838ac3fe(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:54:59,257 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:59,258 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:54:59,258 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 6ff47725e297ecc75d44b4d159db9af8/family2 is initiating major compaction (all files) 2023-04-04 17:54:59,258 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:54:59,258 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:54:59,259 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 6ff47725e297ecc75d44b4d159db9af8/family2 in testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:54:59,259 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/68657a937d4640aab8b5019f4b736893] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp, totalSize=25.4 K 2023-04-04 17:54:59,259 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 5cbf6586996047a38a914b91eeb94ce5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888032 2023-04-04 17:54:59,260 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 45d38c8f13f44763a8b747a17457d570, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:54:59,260 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 9353233eda0e4195b7b11c338329f5b7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:54:59,260 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 95922578f8184b82bfea32731ccbfe2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:54:59,261 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 68657a937d4640aab8b5019f4b736893, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-04 17:54:59,271 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 6ff47725e297ecc75d44b4d159db9af8#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:54:59,284 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023040405d1c1bf093844d4b6ffb8839d72f8fd_del 2023-04-04 17:54:59,284 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040405d1c1bf093844d4b6ffb8839d72f8fd_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040405d1c1bf093844d4b6ffb8839d72f8fd_del 2023-04-04 17:54:59,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/ae821fda627242d9bbe3b6cb6e961b4b] to archive 2023-04-04 17:54:59,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:59,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f78ee851ef1b4aff997b9f5e9a0ee1fb 2023-04-04 17:54:59,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/475e3d7fe9824c9eb210cdfcce6452ac 2023-04-04 17:54:59,323 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f845782cb8a4e96965685434e3357ae 2023-04-04 17:54:59,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/f535099c21134b7ea2c2a8ce3df5d654 2023-04-04 17:54:59,324 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/8f845782cb8a4e96965685434e3357ae as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/8f845782cb8a4e96965685434e3357ae 2023-04-04 17:54:59,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/5873d4df722e453592e4dc912c68dc37 2023-04-04 17:54:59,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/ae821fda627242d9bbe3b6cb6e961b4b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/ae821fda627242d9bbe3b6cb6e961b4b 2023-04-04 17:54:59,328 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f845782cb8a4e96965685434e3357ae 2023-04-04 17:54:59,329 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6ff47725e297ecc75d44b4d159db9af8/family2 of 6ff47725e297ecc75d44b4d159db9af8 into 8f845782cb8a4e96965685434e3357ae(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:54:59,329 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:54:59,329 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:54:59,329 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 74a0b5f9ac541529f0620ee3e73b0156/family1 is initiating major compaction (all files) 2023-04-04 17:54:59,329 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:54:59,329 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:54:59,329 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 74a0b5f9ac541529f0620ee3e73b0156/family1 in testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:54:59,330 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/43016a587f2d4a5da0248f357c2e2b0c] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp, totalSize=26.7 K 2023-04-04 17:54:59,330 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 8e39f6631c3a4bada81c47aeb22ddd21, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888030 2023-04-04 17:54:59,331 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 8cacce2752c642e19b04e52251f66f09, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889492 2023-04-04 17:54:59,331 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting b6e0163fc14148869c6ccae015583e55, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:54:59,331 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 9a57cfb9ec4c4a21a7c494f71987a889, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:54:59,332 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 43016a587f2d4a5da0248f357c2e2b0c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-04 17:54:59,342 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 74a0b5f9ac541529f0620ee3e73b0156#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:54:59,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/68657a937d4640aab8b5019f4b736893] to archive 2023-04-04 17:54:59,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:54:59,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/5cbf6586996047a38a914b91eeb94ce5 2023-04-04 17:54:59,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/45d38c8f13f44763a8b747a17457d570 2023-04-04 17:54:59,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/9353233eda0e4195b7b11c338329f5b7 2023-04-04 17:54:59,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/95922578f8184b82bfea32731ccbfe2e 2023-04-04 17:54:59,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/68657a937d4640aab8b5019f4b736893 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/68657a937d4640aab8b5019f4b736893 2023-04-04 17:54:59,752 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230404ddc5a8ff8c3f4fb590a8e3695fe4ae0e_del 2023-04-04 17:54:59,752 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404ddc5a8ff8c3f4fb590a8e3695fe4ae0e_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ddc5a8ff8c3f4fb590a8e3695fe4ae0e_del 2023-04-04 17:55:00,568 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65f5a8195d02421c88a11c467b27712e 2023-04-04 17:55:00,569 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/65f5a8195d02421c88a11c467b27712e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/65f5a8195d02421c88a11c467b27712e 2023-04-04 17:55:00,573 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65f5a8195d02421c88a11c467b27712e 2023-04-04 17:55:00,573 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 74a0b5f9ac541529f0620ee3e73b0156/family1 of 74a0b5f9ac541529f0620ee3e73b0156 into 65f5a8195d02421c88a11c467b27712e(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:00,574 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:00,574 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:00,574 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 74a0b5f9ac541529f0620ee3e73b0156/family2 is initiating major compaction (all files) 2023-04-04 17:55:00,574 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:00,574 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:00,574 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 74a0b5f9ac541529f0620ee3e73b0156/family2 in testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:00,574 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/b9692a9f088443fea9443776b0fafc29] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp, totalSize=25.4 K 2023-04-04 17:55:00,575 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 1748b008902e450ca6f76dd015bbbabc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888030 2023-04-04 17:55:00,575 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 40d9ed85cd1645acb38412ab48403ca0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889492 2023-04-04 17:55:00,575 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 07a91df8b4184ce4926ec30a4bcf22b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:55:00,576 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 8e900dada18a42c3a6a71dbc6a3a79ad, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:00,576 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting b9692a9f088443fea9443776b0fafc29, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-04 17:55:00,586 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 74a0b5f9ac541529f0620ee3e73b0156#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:00,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/43016a587f2d4a5da0248f357c2e2b0c] to archive 2023-04-04 17:55:00,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:00,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e39f6631c3a4bada81c47aeb22ddd21 2023-04-04 17:55:00,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8cacce2752c642e19b04e52251f66f09 2023-04-04 17:55:00,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/b6e0163fc14148869c6ccae015583e55 2023-04-04 17:55:00,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/9a57cfb9ec4c4a21a7c494f71987a889 2023-04-04 17:55:00,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/43016a587f2d4a5da0248f357c2e2b0c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/43016a587f2d4a5da0248f357c2e2b0c 2023-04-04 17:55:00,994 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230404822eec6227744629949c7bade3f87c08_del 2023-04-04 17:55:00,994 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404822eec6227744629949c7bade3f87c08_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404822eec6227744629949c7bade3f87c08_del 2023-04-04 17:55:01,808 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a7d2fccceed42a18af8c99a4b67ecfb 2023-04-04 17:55:01,809 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/2a7d2fccceed42a18af8c99a4b67ecfb as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/2a7d2fccceed42a18af8c99a4b67ecfb 2023-04-04 17:55:01,814 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a7d2fccceed42a18af8c99a4b67ecfb 2023-04-04 17:55:01,815 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 74a0b5f9ac541529f0620ee3e73b0156/family2 of 74a0b5f9ac541529f0620ee3e73b0156 into 2a7d2fccceed42a18af8c99a4b67ecfb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:01,815 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:01,815 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:01,815 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): a2a935adeee11188aab1d3e9831bfb11/family1 is initiating major compaction (all files) 2023-04-04 17:55:01,816 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:01,816 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:01,816 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of a2a935adeee11188aab1d3e9831bfb11/family1 in testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:01,816 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/2a59216d676e42a4a44b195e14ec58b7] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp, totalSize=26.7 K 2023-04-04 17:55:01,817 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 14ca5735b3714b0abf841c5ca9e0090a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888033 2023-04-04 17:55:01,817 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 45174dda5ce14291987f01d60113f3c8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:55:01,818 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting f5f147bf268b4b3290dcbe1dc8b5fab6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890920 2023-04-04 17:55:01,818 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting c70a58d56195450ab099353e6d710155, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:01,819 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 2a59216d676e42a4a44b195e14ec58b7, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-04 17:55:01,836 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): a2a935adeee11188aab1d3e9831bfb11#family1#compaction#112 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:01,844 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023040412e72c08810347b49cadd56ea08e9c5d_del 2023-04-04 17:55:01,844 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040412e72c08810347b49cadd56ea08e9c5d_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040412e72c08810347b49cadd56ea08e9c5d_del 2023-04-04 17:55:01,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/b9692a9f088443fea9443776b0fafc29] to archive 2023-04-04 17:55:01,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:01,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/1748b008902e450ca6f76dd015bbbabc 2023-04-04 17:55:01,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/40d9ed85cd1645acb38412ab48403ca0 2023-04-04 17:55:01,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/07a91df8b4184ce4926ec30a4bcf22b0 2023-04-04 17:55:01,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/8e900dada18a42c3a6a71dbc6a3a79ad 2023-04-04 17:55:01,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/b9692a9f088443fea9443776b0fafc29 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/b9692a9f088443fea9443776b0fafc29 2023-04-04 17:55:02,659 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a474cbfa9bc94c7098141a5f05998d72 2023-04-04 17:55:02,660 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/a474cbfa9bc94c7098141a5f05998d72 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/a474cbfa9bc94c7098141a5f05998d72 2023-04-04 17:55:02,663 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a474cbfa9bc94c7098141a5f05998d72 2023-04-04 17:55:02,664 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a2a935adeee11188aab1d3e9831bfb11/family1 of a2a935adeee11188aab1d3e9831bfb11 into a474cbfa9bc94c7098141a5f05998d72(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:02,664 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:02,664 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:02,665 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): a2a935adeee11188aab1d3e9831bfb11/family2 is initiating major compaction (all files) 2023-04-04 17:55:02,665 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:02,665 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:02,665 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of a2a935adeee11188aab1d3e9831bfb11/family2 in testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:02,665 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/afc4817502714463987cddfd409cdd00] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp, totalSize=25.4 K 2023-04-04 17:55:02,666 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting d2419f86ce0c465aadac914d1f568abf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888033 2023-04-04 17:55:02,666 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 60c38c3347d444ba83850f4b1e43a5aa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:55:02,666 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 905da60919a64529ab99e2d888482cfb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890920 2023-04-04 17:55:02,667 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 73c1df600ff14b9a9a9f9effe69c3316, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:02,667 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting afc4817502714463987cddfd409cdd00, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-04 17:55:02,678 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): a2a935adeee11188aab1d3e9831bfb11#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:02,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/2a59216d676e42a4a44b195e14ec58b7] to archive 2023-04-04 17:55:02,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:02,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/14ca5735b3714b0abf841c5ca9e0090a 2023-04-04 17:55:02,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/45174dda5ce14291987f01d60113f3c8 2023-04-04 17:55:02,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f5f147bf268b4b3290dcbe1dc8b5fab6 2023-04-04 17:55:02,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c70a58d56195450ab099353e6d710155 2023-04-04 17:55:02,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/2a59216d676e42a4a44b195e14ec58b7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/2a59216d676e42a4a44b195e14ec58b7 2023-04-04 17:55:03,090 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230404942ce25996614aba961939a251ae1ccc_del 2023-04-04 17:55:03,090 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404942ce25996614aba961939a251ae1ccc_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404942ce25996614aba961939a251ae1ccc_del 2023-04-04 17:55:03,506 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48d519a1a7de477ebf55fc9a301d90c3 2023-04-04 17:55:03,507 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/48d519a1a7de477ebf55fc9a301d90c3 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/48d519a1a7de477ebf55fc9a301d90c3 2023-04-04 17:55:03,512 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48d519a1a7de477ebf55fc9a301d90c3 2023-04-04 17:55:03,513 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a2a935adeee11188aab1d3e9831bfb11/family2 of a2a935adeee11188aab1d3e9831bfb11 into 48d519a1a7de477ebf55fc9a301d90c3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:03,513 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:03,519 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:03,525 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:03,544 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:03,553 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:03,563 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-04 17:55:03,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/afc4817502714463987cddfd409cdd00] to archive 2023-04-04 17:55:03,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:03,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/d2419f86ce0c465aadac914d1f568abf 2023-04-04 17:55:03,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/60c38c3347d444ba83850f4b1e43a5aa 2023-04-04 17:55:03,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/905da60919a64529ab99e2d888482cfb 2023-04-04 17:55:03,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/73c1df600ff14b9a9a9f9effe69c3316 2023-04-04 17:55:03,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/afc4817502714463987cddfd409cdd00 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/afc4817502714463987cddfd409cdd00 2023-04-04 17:55:03,623 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-04-04 17:55:03,626 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230404ddc5a8ff8c3f4fb590a8e3695fe4ae0e_del 2023-04-04 17:55:03,630 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230404e55a7c74e5cf4612ba0e197983baa3ba_del 2023-04-04 17:55:03,633 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023040412e72c08810347b49cadd56ea08e9c5d_del 2023-04-04 17:55:03,634 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:03,634 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(139): Connect 0x63637869 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:55:03,639 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48144f16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:55:03,639 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:03,639 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:03,639 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:04,127 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304040922dc08b35e4cdeba154c696ab01035 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304040922dc08b35e4cdeba154c696ab01035 2023-04-04 17:55:04,128 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:04,141 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:55:04,144 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:55:04,152 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:55:04,155 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:55:04,168 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/5795c7d3e12644b8914702c35d7be72d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-04-04 17:55:04,169 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/5795c7d3e12644b8914702c35d7be72d}] 2023-04-04 17:55:04,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/5795c7d3e12644b8914702c35d7be72d for inclusion in a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:55:04,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-04-04 17:55:04,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-04 17:55:04,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:04,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/5795c7d3e12644b8914702c35d7be72d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__vcunmptggfdfu8rdrjj3ucc9jdbv9v25hpc5vult65opgnngd7q7lfa4dis6t37g/family1/5795c7d3e12644b8914702c35d7be72d 2023-04-04 17:55:04,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__vcunmptggfdfu8rdrjj3ucc9jdbv9v25hpc5vult65opgnngd7q7lfa4dis6t37g/family1/5795c7d3e12644b8914702c35d7be72d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_ 2023-04-04 17:55:04,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__vcunmptggfdfu8rdrjj3ucc9jdbv9v25hpc5vult65opgnngd7q7lfa4dis6t37g/family1/5795c7d3e12644b8914702c35d7be72d into a2a935adeee11188aab1d3e9831bfb11/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_ - updating store file list. 2023-04-04 17:55:04,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_ into a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:55:04,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__vcunmptggfdfu8rdrjj3ucc9jdbv9v25hpc5vult65opgnngd7q7lfa4dis6t37g/family1/5795c7d3e12644b8914702c35d7be72d into a2a935adeee11188aab1d3e9831bfb11/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_) 2023-04-04 17:55:04,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__vcunmptggfdfu8rdrjj3ucc9jdbv9v25hpc5vult65opgnngd7q7lfa4dis6t37g/family1/5795c7d3e12644b8914702c35d7be72d 2023-04-04 17:55:04,188 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:04,188 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:04,190 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 2023-04-04 17:55:04,191 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 2023-04-04 17:55:04,192 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 2023-04-04 17:55:04,192 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a 2023-04-04 17:55:04,192 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-04 17:55:04,192 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404' 2023-04-04 17:55:04,193 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:04,518 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304040458c086aefa4d849d769150fb4aad77 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304040458c086aefa4d849d769150fb4aad77 2023-04-04 17:55:04,519 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:04,521 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040462e9787d600c475c83dcaa12160d709f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040462e9787d600c475c83dcaa12160d709f 2023-04-04 17:55:04,522 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:04,546 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/c0b1f16c47dc4174baee488ff849876b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-04-04 17:55:04,546 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1664b041bf1b46f288dab926ddc2a5cc first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-04-04 17:55:04,548 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/c0b1f16c47dc4174baee488ff849876b}] 2023-04-04 17:55:04,548 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1664b041bf1b46f288dab926ddc2a5cc}] 2023-04-04 17:55:04,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1664b041bf1b46f288dab926ddc2a5cc for inclusion in 74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:55:04,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/c0b1f16c47dc4174baee488ff849876b for inclusion in 6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:55:04,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-04-04 17:55:04,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-04-04 17:55:04,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-04 17:55:04,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last=1 2023-04-04 17:55:04,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:04,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:55:04,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/c0b1f16c47dc4174baee488ff849876b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__q1t99tiogd7vr4iclmvhlooljahfcrrld3bepe6a275atouasbv1pslgt6djrkev/family1/c0b1f16c47dc4174baee488ff849876b 2023-04-04 17:55:04,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1664b041bf1b46f288dab926ddc2a5cc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__uh75f81msrik3t1ampb38kqt800cf8a8ruojjdn0qcaqo9nsi8i4f74gvrts2bn5/family1/1664b041bf1b46f288dab926ddc2a5cc 2023-04-04 17:55:04,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__q1t99tiogd7vr4iclmvhlooljahfcrrld3bepe6a275atouasbv1pslgt6djrkev/family1/c0b1f16c47dc4174baee488ff849876b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_ 2023-04-04 17:55:04,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__uh75f81msrik3t1ampb38kqt800cf8a8ruojjdn0qcaqo9nsi8i4f74gvrts2bn5/family1/1664b041bf1b46f288dab926ddc2a5cc as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_ 2023-04-04 17:55:04,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__q1t99tiogd7vr4iclmvhlooljahfcrrld3bepe6a275atouasbv1pslgt6djrkev/family1/c0b1f16c47dc4174baee488ff849876b into 6ff47725e297ecc75d44b4d159db9af8/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_ - updating store file list. 2023-04-04 17:55:04,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__uh75f81msrik3t1ampb38kqt800cf8a8ruojjdn0qcaqo9nsi8i4f74gvrts2bn5/family1/1664b041bf1b46f288dab926ddc2a5cc into 74a0b5f9ac541529f0620ee3e73b0156/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_ - updating store file list. 2023-04-04 17:55:04,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_ into 6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:55:04,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_ into 74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:55:04,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__q1t99tiogd7vr4iclmvhlooljahfcrrld3bepe6a275atouasbv1pslgt6djrkev/family1/c0b1f16c47dc4174baee488ff849876b into 6ff47725e297ecc75d44b4d159db9af8/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_) 2023-04-04 17:55:04,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__uh75f81msrik3t1ampb38kqt800cf8a8ruojjdn0qcaqo9nsi8i4f74gvrts2bn5/family1/1664b041bf1b46f288dab926ddc2a5cc into 74a0b5f9ac541529f0620ee3e73b0156/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_) 2023-04-04 17:55:04,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__q1t99tiogd7vr4iclmvhlooljahfcrrld3bepe6a275atouasbv1pslgt6djrkev/family1/c0b1f16c47dc4174baee488ff849876b 2023-04-04 17:55:04,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__uh75f81msrik3t1ampb38kqt800cf8a8ruojjdn0qcaqo9nsi8i4f74gvrts2bn5/family1/1664b041bf1b46f288dab926ddc2a5cc 2023-04-04 17:55:04,564 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:04,564 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:04,565 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:04,565 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:04,566 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 2023-04-04 17:55:04,566 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 2023-04-04 17:55:04,567 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a 2023-04-04 17:55:04,567 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 2023-04-04 17:55:04,567 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 2023-04-04 17:55:04,567 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 2023-04-04 17:55:04,568 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 2023-04-04 17:55:04,568 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-04 17:55:04,568 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a 2023-04-04 17:55:04,568 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404' 2023-04-04 17:55:04,568 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-04 17:55:04,568 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404' 2023-04-04 17:55:04,568 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:04,568 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:04,569 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:04,569 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:04,569 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ddc5a8ff8c3f4fb590a8e3695fe4ae0e_del] 2023-04-04 17:55:04,569 DEBUG [Listener at localhost.localdomain/45763] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:04,570 DEBUG [Listener at localhost.localdomain/45763] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ddc5a8ff8c3f4fb590a8e3695fe4ae0e_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230404ddc5a8ff8c3f4fb590a8e3695fe4ae0e_del 2023-04-04 17:55:04,570 INFO [Listener at localhost.localdomain/45763] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-04-04 17:55:04,570 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404e55a7c74e5cf4612ba0e197983baa3ba_del] 2023-04-04 17:55:04,571 DEBUG [Listener at localhost.localdomain/45763] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:04,572 DEBUG [Listener at localhost.localdomain/45763] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404e55a7c74e5cf4612ba0e197983baa3ba_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230404e55a7c74e5cf4612ba0e197983baa3ba_del 2023-04-04 17:55:04,572 INFO [Listener at localhost.localdomain/45763] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-04-04 17:55:04,572 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040412e72c08810347b49cadd56ea08e9c5d_del] 2023-04-04 17:55:04,572 DEBUG [Listener at localhost.localdomain/45763] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:04,573 DEBUG [Listener at localhost.localdomain/45763] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040412e72c08810347b49cadd56ea08e9c5d_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040412e72c08810347b49cadd56ea08e9c5d_del 2023-04-04 17:55:04,573 INFO [Listener at localhost.localdomain/45763] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-04-04 17:55:04,576 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:04,579 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:04,583 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:04,584 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:04,589 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-04-04 17:55:04,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testCompactionWithHFileLink 2023-04-04 17:55:04,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-04-04 17:55:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-04-04 17:55:04,592 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630904592"}]},"ts":"1680630904592"} 2023-04-04 17:55:04,594 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-04-04 17:55:04,595 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-04-04 17:55:04,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, UNASSIGN}] 2023-04-04 17:55:04,597 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, UNASSIGN 2023-04-04 17:55:04,597 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, UNASSIGN 2023-04-04 17:55:04,597 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, UNASSIGN 2023-04-04 17:55:04,597 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a2a935adeee11188aab1d3e9831bfb11, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:04,597 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=74a0b5f9ac541529f0620ee3e73b0156, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:04,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6ff47725e297ecc75d44b4d159db9af8, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:04,597 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630904597"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630904597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630904597"}]},"ts":"1680630904597"} 2023-04-04 17:55:04,598 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630904597"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630904597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630904597"}]},"ts":"1680630904597"} 2023-04-04 17:55:04,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630904597"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630904597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630904597"}]},"ts":"1680630904597"} 2023-04-04 17:55:04,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure a2a935adeee11188aab1d3e9831bfb11, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:04,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 74a0b5f9ac541529f0620ee3e73b0156, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:04,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 6ff47725e297ecc75d44b4d159db9af8, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:04,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-04-04 17:55:04,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:04,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a2a935adeee11188aab1d3e9831bfb11, disabling compactions & flushes 2023-04-04 17:55:04,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:04,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:04,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. after waiting 0 ms 2023-04-04 17:55:04,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:04,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-04-04 17:55:04,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:04,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:04,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:04,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:04,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 6ff47725e297ecc75d44b4d159db9af8, disabling compactions & flushes 2023-04-04 17:55:04,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:04,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:04,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. after waiting 0 ms 2023-04-04 17:55:04,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:04,764 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a2a935adeee11188aab1d3e9831bfb11, regionState=CLOSED 2023-04-04 17:55:04,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630904764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630904764"}]},"ts":"1680630904764"} 2023-04-04 17:55:04,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-04-04 17:55:04,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure a2a935adeee11188aab1d3e9831bfb11, server=jenkins-hbase17.apache.org,46251,1680630785259 in 168 msec 2023-04-04 17:55:04,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-04-04 17:55:04,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, UNASSIGN in 172 msec 2023-04-04 17:55:04,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:04,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:55:04,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:04,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(109): Close 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 74a0b5f9ac541529f0620ee3e73b0156, disabling compactions & flushes 2023-04-04 17:55:04,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. after waiting 0 ms 2023-04-04 17:55:04,770 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6ff47725e297ecc75d44b4d159db9af8, regionState=CLOSED 2023-04-04 17:55:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:04,770 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630904770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630904770"}]},"ts":"1680630904770"} 2023-04-04 17:55:04,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-04-04 17:55:04,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 6ff47725e297ecc75d44b4d159db9af8, server=jenkins-hbase17.apache.org,46251,1680630785259 in 172 msec 2023-04-04 17:55:04,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, UNASSIGN in 178 msec 2023-04-04 17:55:04,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-04-04 17:55:04,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:04,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:04,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(147): Closed 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:04,776 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=74a0b5f9ac541529f0620ee3e73b0156, regionState=CLOSED 2023-04-04 17:55:04,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630904776"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630904776"}]},"ts":"1680630904776"} 2023-04-04 17:55:04,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-04-04 17:55:04,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 74a0b5f9ac541529f0620ee3e73b0156, server=jenkins-hbase17.apache.org,46251,1680630785259 in 178 msec 2023-04-04 17:55:04,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-04-04 17:55:04,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, UNASSIGN in 183 msec 2023-04-04 17:55:04,780 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630904780"}]},"ts":"1680630904780"} 2023-04-04 17:55:04,781 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-04-04 17:55:04,782 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-04-04 17:55:04,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 193 msec 2023-04-04 17:55:04,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-04-04 17:55:04,896 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-04-04 17:55:04,911 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:04,912 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1580): Client=jenkins//136.243.18.41 snapshot request for:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-04 17:55:04,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1680630904912 (current time:1680630904912). 2023-04-04 17:55:04,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-04-04 17:55:04,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] zookeeper.ReadOnlyZKClient(139): Connect 0x6e65d9d6 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:55:04,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76c5a69e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:55:04,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:55:04,920 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:55:04,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e65d9d6 to 127.0.0.1:61441 2023-04-04 17:55:04,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:55:04,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-04-04 17:55:04,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-04 17:55:04,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-04 17:55:04,925 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-04 17:55:04,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-04 17:55:04,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1680630894544-1680630904911 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-04-04 17:55:04,926 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1680631504926 2023-04-04 17:55:04,926 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:04,926 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-04-04 17:55:05,027 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:55:05,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:55:05,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:55:05,030 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-04-04 17:55:05,230 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:55:05,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:55:05,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:55:05,233 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-04-04 17:55:05,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-04 17:55:05,341 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/a474cbfa9bc94c7098141a5f05998d72, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_] hfiles 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/a474cbfa9bc94c7098141a5f05998d72 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_ 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/65f5a8195d02421c88a11c467b27712e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_] hfiles 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/08c5f498f34a4635b6cbaa91838ac3fe, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_] hfiles 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304040458c086aefa4d849d769150fb4aad77, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304040922dc08b35e4cdeba154c696ab01035, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040462e9787d600c475c83dcaa12160d709f] hfiles 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/65f5a8195d02421c88a11c467b27712e 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304040458c086aefa4d849d769150fb4aad77 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/08c5f498f34a4635b6cbaa91838ac3fe 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304040922dc08b35e4cdeba154c696ab01035 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_ 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040462e9787d600c475c83dcaa12160d709f 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_ 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/48d519a1a7de477ebf55fc9a301d90c3] hfiles 2023-04-04 17:55:05,344 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/48d519a1a7de477ebf55fc9a301d90c3 2023-04-04 17:55:05,345 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/2a7d2fccceed42a18af8c99a4b67ecfb] hfiles 2023-04-04 17:55:05,345 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/2a7d2fccceed42a18af8c99a4b67ecfb 2023-04-04 17:55:05,345 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/8f845782cb8a4e96965685434e3357ae] hfiles 2023-04-04 17:55:05,345 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/8f845782cb8a4e96965685434e3357ae 2023-04-04 17:55:05,350 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040405d1c1bf093844d4b6ffb8839d72f8fd_del, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304046633bf1bc3d94650a78ed09cfdebce9b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304049ff063b6b3664893ac264ae0b45d8f40, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404b76c96b871d7404b832e5a0b22d46ef8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404dba2cd11143d48b38b001379fb126eab, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040402002228086549e6862f4185db1232d1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304046cec317e139c414ba7726616b670b82c, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304048d2de19a8c4e48b5951af8643316a641, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404942ce25996614aba961939a251ae1ccc_del, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404bc842dac2e464acd9f66dfd926285e69, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304043b8e54835cdf491da80e0aa10fa61fe0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023040448789c1ada1648f8bd2f5efe20cf9e2e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304047ef0523619fd4eab90fa81c17f5fa636, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404822eec6227744629949c7bade3f87c08_del, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404e20f4064454640e4bcf6d7c368468677] hfiles 2023-04-04 17:55:05,350 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040405d1c1bf093844d4b6ffb8839d72f8fd_del 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304046633bf1bc3d94650a78ed09cfdebce9b 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304049ff063b6b3664893ac264ae0b45d8f40 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404b76c96b871d7404b832e5a0b22d46ef8 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230404dba2cd11143d48b38b001379fb126eab 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040402002228086549e6862f4185db1232d1 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304046cec317e139c414ba7726616b670b82c 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304048d2de19a8c4e48b5951af8643316a641 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404942ce25996614aba961939a251ae1ccc_del 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404bc842dac2e464acd9f66dfd926285e69 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304043b8e54835cdf491da80e0aa10fa61fe0 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023040448789c1ada1648f8bd2f5efe20cf9e2e 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304047ef0523619fd4eab90fa81c17f5fa636 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404822eec6227744629949c7bade3f87c08_del 2023-04-04 17:55:05,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404e20f4064454640e4bcf6d7c368468677 2023-04-04 17:55:05,533 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:55:05,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:55:05,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:55:05,535 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-04-04 17:55:05,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-04-04 17:55:05,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:05,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:06,035 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:55:06,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:55:06,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-04 17:55:06,037 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-04-04 17:55:06,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680630894544-1680630904911 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:06,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1680630894544-1680630904911 of table testCompactionWithHFileLink completed 2023-04-04 17:55:06,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:06,264 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:06,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1680630894544-1680630904911 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1680630904926Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1680630905338 (+412 ms)Consolidate snapshot: hbase-failsafe-snaptb-1680630894544-1680630904911 at 1680630905752 (+414 ms)Loading Region manifests for hbase-failsafe-snaptb-1680630894544-1680630904911 at 1680630905752Writing data manifest for hbase-failsafe-snaptb-1680630894544-1680630904911 at 1680630905755 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1680630894544-1680630904911 at 1680630906162 (+407 ms)Snapshot hbase-failsafe-snaptb-1680630894544-1680630904911 of table testCompactionWithHFileLink completed at 1680630906264 (+102 ms) 2023-04-04 17:55:06,266 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-04 17:55:06,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.3420 sec 2023-04-04 17:55:07,037 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-04 17:55:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-04 17:55:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1680630894544-1680630904911 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-04-04 17:55:07,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1680630894544" table: "testCompactionWithHFileLink" creation_time: 1680630894567 type: FLUSH version: 2 ttl: 0 ) 2023-04-04 17:55:07,109 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1680630894544 as table=testCompactionWithHFileLink 2023-04-04 17:55:07,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-04 17:55:07,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-04 17:55:07,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-04 17:55:07,524 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-04-04 17:55:07,525 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-04-04 17:55:07,525 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-04-04 17:55:07,526 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-04 17:55:07,531 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1680630894544" table: "testCompactionWithHFileLink" creation_time: 1680630894567 type: FLUSH version: 2 ttl: 0 2023-04-04 17:55:07,532 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink 2023-04-04 17:55:07,539 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-04-04 17:55:07,545 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304040922dc08b35e4cdeba154c696ab01035 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304040922dc08b35e4cdeba154c696ab01035 2023-04-04 17:55:07,552 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304040458c086aefa4d849d769150fb4aad77 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304040458c086aefa4d849d769150fb4aad77 2023-04-04 17:55:07,553 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040462e9787d600c475c83dcaa12160d709f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040462e9787d600c475c83dcaa12160d709f 2023-04-04 17:55:07,553 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,558 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,567 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,571 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,577 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,582 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,586 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,597 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,600 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,604 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,607 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,613 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 of snapshot=snaptb-1680630894544 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-04 17:55:07,621 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404822eec6227744629949c7bade3f87c08_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230404822eec6227744629949c7bade3f87c08_del 2023-04-04 17:55:07,622 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404942ce25996614aba961939a251ae1ccc_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230404942ce25996614aba961939a251ae1ccc_del 2023-04-04 17:55:07,623 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040405d1c1bf093844d4b6ffb8839d72f8fd_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040405d1c1bf093844d4b6ffb8839d72f8fd_del 2023-04-04 17:55:07,624 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:07,624 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:07,624 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:07,632 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/c102d45627314c5096ebbbcad432e27d_SeqId_29_ 2023-04-04 17:55:07,632 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/08c5f498f34a4635b6cbaa91838ac3fe to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/08c5f498f34a4635b6cbaa91838ac3fe 2023-04-04 17:55:07,632 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/c93ede926869454ab9ab5072025a1e59_SeqId_29_ 2023-04-04 17:55:07,633 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/65f5a8195d02421c88a11c467b27712e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/65f5a8195d02421c88a11c467b27712e 2023-04-04 17:55:07,633 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8e39f6631c3a4bada81c47aeb22ddd21 of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,633 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/8e6f796206db448fb8dcc82445878d84_SeqId_29_ 2023-04-04 17:55:07,633 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f78ee851ef1b4aff997b9f5e9a0ee1fb of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,634 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/a474cbfa9bc94c7098141a5f05998d72 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/a474cbfa9bc94c7098141a5f05998d72 2023-04-04 17:55:07,634 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 14ca5735b3714b0abf841c5ca9e0090a of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,642 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8cacce2752c642e19b04e52251f66f09 of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,642 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 475e3d7fe9824c9eb210cdfcce6452ac of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,647 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 45174dda5ce14291987f01d60113f3c8 of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,648 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f535099c21134b7ea2c2a8ce3df5d654 of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,648 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b6e0163fc14148869c6ccae015583e55 of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,650 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f5f147bf268b4b3290dcbe1dc8b5fab6 of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,653 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9a57cfb9ec4c4a21a7c494f71987a889 of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,653 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5873d4df722e453592e4dc912c68dc37 of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,658 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/2a7d2fccceed42a18af8c99a4b67ecfb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/2a7d2fccceed42a18af8c99a4b67ecfb 2023-04-04 17:55:07,658 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1748b008902e450ca6f76dd015bbbabc of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,658 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/8f845782cb8a4e96965685434e3357ae to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/8f845782cb8a4e96965685434e3357ae 2023-04-04 17:55:07,658 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5cbf6586996047a38a914b91eeb94ce5 of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,663 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c70a58d56195450ab099353e6d710155 of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,667 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 45d38c8f13f44763a8b747a17457d570 of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,682 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 40d9ed85cd1645acb38412ab48403ca0 of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,686 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9353233eda0e4195b7b11c338329f5b7 of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,686 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/48d519a1a7de477ebf55fc9a301d90c3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/48d519a1a7de477ebf55fc9a301d90c3 2023-04-04 17:55:07,686 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d2419f86ce0c465aadac914d1f568abf of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,693 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 07a91df8b4184ce4926ec30a4bcf22b0 of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,694 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 60c38c3347d444ba83850f4b1e43a5aa of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,695 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 95922578f8184b82bfea32731ccbfe2e of snapshot=snaptb-1680630894544 to region=6ff47725e297ecc75d44b4d159db9af8 table=testCompactionWithHFileLink 2023-04-04 17:55:07,698 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8e900dada18a42c3a6a71dbc6a3a79ad of snapshot=snaptb-1680630894544 to region=74a0b5f9ac541529f0620ee3e73b0156 table=testCompactionWithHFileLink 2023-04-04 17:55:07,702 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 905da60919a64529ab99e2d888482cfb of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,712 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 73c1df600ff14b9a9a9f9effe69c3316 of snapshot=snaptb-1680630894544 to region=a2a935adeee11188aab1d3e9831bfb11 table=testCompactionWithHFileLink 2023-04-04 17:55:07,716 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1680630894544" table: "testCompactionWithHFileLink" creation_time: 1680630894567 type: FLUSH version: 2 ttl: 0 2023-04-04 17:55:07,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-04 17:55:07,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680630907717"}]},"ts":"9223372036854775807"} 2023-04-04 17:55:07,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680630907717"}]},"ts":"9223372036854775807"} 2023-04-04 17:55:07,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680630907717"}]},"ts":"9223372036854775807"} 2023-04-04 17:55:07,719 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-04-04 17:55:07,719 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ff47725e297ecc75d44b4d159db9af8, NAME => 'testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 74a0b5f9ac541529f0620ee3e73b0156, NAME => 'testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a2a935adeee11188aab1d3e9831bfb11, NAME => 'testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.', STARTKEY => '2', ENDKEY => ''}] 2023-04-04 17:55:07,719 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630907718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630907718"}]},"ts":"1680630907718"} 2023-04-04 17:55:07,719 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630907718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630907718"}]},"ts":"1680630907718"} 2023-04-04 17:55:07,719 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630907718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630907718"}]},"ts":"1680630907718"} 2023-04-04 17:55:07,722 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-04 17:55:07,722 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-04-04 17:55:07,722 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 6ff47725e297ecc75d44b4d159db9af8, NAME => 'testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 74a0b5f9ac541529f0620ee3e73b0156, NAME => 'testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a2a935adeee11188aab1d3e9831bfb11, NAME => 'testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.', STARTKEY => '2', ENDKEY => ''}] 2023-04-04 17:55:07,722 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1680630894544 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-04-04 17:55:07,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1680630894544" table: "testCompactionWithHFileLink" creation_time: 1680630894567 type: FLUSH version: 2 ttl: 0 ) in 627 msec 2023-04-04 17:55:08,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-04 17:55:08,217 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-04-04 17:55:08,217 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:08,221 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(748): Client=jenkins//136.243.18.41 delete name: "hbase-failsafe-snaptb-1680630894544-1680630904911" 2023-04-04 17:55:08,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1680630894544-1680630904911 2023-04-04 17:55:08,227 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-04-04 17:55:08,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.HMaster$10(2385): Client=jenkins//136.243.18.41 enable testCompactionWithHFileLink 2023-04-04 17:55:08,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-04-04 17:55:08,240 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-04-04 17:55:08,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-04 17:55:08,240 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630908240"}]},"ts":"1680630908240"} 2023-04-04 17:55:08,241 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-04-04 17:55:08,243 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-04-04 17:55:08,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN}] 2023-04-04 17:55:08,245 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN 2023-04-04 17:55:08,245 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN 2023-04-04 17:55:08,245 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN 2023-04-04 17:55:08,245 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-04-04 17:55:08,245 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-04-04 17:55:08,246 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-04-04 17:55:08,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-04 17:55:08,397 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6ff47725e297ecc75d44b4d159db9af8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:08,397 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a2a935adeee11188aab1d3e9831bfb11, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:08,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=74a0b5f9ac541529f0620ee3e73b0156, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:08,397 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630908397"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630908397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630908397"}]},"ts":"1680630908397"} 2023-04-04 17:55:08,397 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630908397"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630908397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630908397"}]},"ts":"1680630908397"} 2023-04-04 17:55:08,397 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630908397"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630908397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630908397"}]},"ts":"1680630908397"} 2023-04-04 17:55:08,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure a2a935adeee11188aab1d3e9831bfb11, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:08,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 6ff47725e297ecc75d44b4d159db9af8, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:08,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 74a0b5f9ac541529f0620ee3e73b0156, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:08,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-04 17:55:08,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:08,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2a935adeee11188aab1d3e9831bfb11, NAME => 'testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.', STARTKEY => '2', ENDKEY => ''} 2023-04-04 17:55:08,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:08,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,555 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,556 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:55:08,556 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:55:08,556 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2a935adeee11188aab1d3e9831bfb11 columnFamilyName family1 2023-04-04 17:55:08,568 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-14ca5735b3714b0abf841c5ca9e0090a 2023-04-04 17:55:08,596 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-45174dda5ce14291987f01d60113f3c8 2023-04-04 17:55:08,602 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-c70a58d56195450ab099353e6d710155 2023-04-04 17:55:08,608 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-f5f147bf268b4b3290dcbe1dc8b5fab6 2023-04-04 17:55:08,608 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(310): Store=a2a935adeee11188aab1d3e9831bfb11/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:08,608 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,609 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2 2023-04-04 17:55:08,609 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2 2023-04-04 17:55:08,610 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2a935adeee11188aab1d3e9831bfb11 columnFamilyName family2 2023-04-04 17:55:08,618 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-60c38c3347d444ba83850f4b1e43a5aa 2023-04-04 17:55:08,625 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-73c1df600ff14b9a9a9f9effe69c3316 2023-04-04 17:55:08,631 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-905da60919a64529ab99e2d888482cfb 2023-04-04 17:55:08,637 DEBUG [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-d2419f86ce0c465aadac914d1f568abf 2023-04-04 17:55:08,637 INFO [StoreOpener-a2a935adeee11188aab1d3e9831bfb11-1] regionserver.HStore(310): Store=a2a935adeee11188aab1d3e9831bfb11/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:08,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:08,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:55:08,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a2a935adeee11188aab1d3e9831bfb11; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67329627, jitterRate=0.00328962504863739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:08,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:08,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11., pid=101, masterSystemTime=1680630908550 2023-04-04 17:55:08,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:55:08,648 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-04 17:55:08,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-04 17:55:08,648 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-04 17:55:08,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:08,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:08,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:08,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ff47725e297ecc75d44b4d159db9af8, NAME => 'testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.', STARTKEY => '1', ENDKEY => '2'} 2023-04-04 17:55:08,650 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a2a935adeee11188aab1d3e9831bfb11, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:08,650 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630908650"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630908650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630908650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630908650"}]},"ts":"1680630908650"} 2023-04-04 17:55:08,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:08,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,651 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-04 17:55:08,651 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-04 17:55:08,651 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1912): a2a935adeee11188aab1d3e9831bfb11/family2 is initiating minor compaction (all files) 2023-04-04 17:55:08,651 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1912): a2a935adeee11188aab1d3e9831bfb11/family1 is initiating minor compaction (all files) 2023-04-04 17:55:08,651 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a2a935adeee11188aab1d3e9831bfb11/family2 in testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:08,652 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a2a935adeee11188aab1d3e9831bfb11/family1 in testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:55:08,652 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-d2419f86ce0c465aadac914d1f568abf, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-60c38c3347d444ba83850f4b1e43a5aa, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-905da60919a64529ab99e2d888482cfb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-73c1df600ff14b9a9a9f9effe69c3316] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp, totalSize=20.4 K 2023-04-04 17:55:08,652 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-14ca5735b3714b0abf841c5ca9e0090a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-45174dda5ce14291987f01d60113f3c8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-f5f147bf268b4b3290dcbe1dc8b5fab6, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-c70a58d56195450ab099353e6d710155] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp, totalSize=21.6 K 2023-04-04 17:55:08,652 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,652 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-d2419f86ce0c465aadac914d1f568abf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888033 2023-04-04 17:55:08,652 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-14ca5735b3714b0abf841c5ca9e0090a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888033 2023-04-04 17:55:08,653 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:55:08,653 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:55:08,653 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-60c38c3347d444ba83850f4b1e43a5aa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:55:08,653 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ff47725e297ecc75d44b4d159db9af8 columnFamilyName family1 2023-04-04 17:55:08,653 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-45174dda5ce14291987f01d60113f3c8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:55:08,654 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-905da60919a64529ab99e2d888482cfb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890920 2023-04-04 17:55:08,654 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-f5f147bf268b4b3290dcbe1dc8b5fab6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890920 2023-04-04 17:55:08,655 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-c70a58d56195450ab099353e6d710155, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:08,655 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-73c1df600ff14b9a9a9f9effe69c3316, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:08,657 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-04-04 17:55:08,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure a2a935adeee11188aab1d3e9831bfb11, server=jenkins-hbase17.apache.org,46251,1680630785259 in 255 msec 2023-04-04 17:55:08,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a2a935adeee11188aab1d3e9831bfb11, ASSIGN in 415 msec 2023-04-04 17:55:08,673 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-475e3d7fe9824c9eb210cdfcce6452ac 2023-04-04 17:55:08,696 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5873d4df722e453592e4dc912c68dc37 2023-04-04 17:55:08,708 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f535099c21134b7ea2c2a8ce3df5d654 2023-04-04 17:55:08,712 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): a2a935adeee11188aab1d3e9831bfb11#family1#compaction#115 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:08,718 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] throttle.PressureAwareThroughputController(145): a2a935adeee11188aab1d3e9831bfb11#family2#compaction#114 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:08,732 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f78ee851ef1b4aff997b9f5e9a0ee1fb 2023-04-04 17:55:08,732 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(310): Store=6ff47725e297ecc75d44b4d159db9af8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:08,732 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,733 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2 2023-04-04 17:55:08,733 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2 2023-04-04 17:55:08,734 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ff47725e297ecc75d44b4d159db9af8 columnFamilyName family2 2023-04-04 17:55:08,746 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-45d38c8f13f44763a8b747a17457d570 2023-04-04 17:55:08,751 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5cbf6586996047a38a914b91eeb94ce5 2023-04-04 17:55:08,756 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-9353233eda0e4195b7b11c338329f5b7 2023-04-04 17:55:08,760 DEBUG [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-95922578f8184b82bfea32731ccbfe2e 2023-04-04 17:55:08,761 INFO [StoreOpener-6ff47725e297ecc75d44b4d159db9af8-1] regionserver.HStore(310): Store=6ff47725e297ecc75d44b4d159db9af8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:08,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:08,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:55:08,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 6ff47725e297ecc75d44b4d159db9af8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74693644, jitterRate=0.11302202939987183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:08,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:55:08,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8., pid=102, masterSystemTime=1680630908550 2023-04-04 17:55:08,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-04 17:55:08,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-04-04 17:55:08,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:08,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:08,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:08,768 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6ff47725e297ecc75d44b4d159db9af8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 74a0b5f9ac541529f0620ee3e73b0156, NAME => 'testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.', STARTKEY => '', ENDKEY => '1'} 2023-04-04 17:55:08,768 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630908768"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630908768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630908768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630908768"}]},"ts":"1680630908768"} 2023-04-04 17:55:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,770 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=99 2023-04-04 17:55:08,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 6ff47725e297ecc75d44b4d159db9af8, server=jenkins-hbase17.apache.org,46251,1680630785259 in 370 msec 2023-04-04 17:55:08,770 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:55:08,770 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:55:08,771 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a0b5f9ac541529f0620ee3e73b0156 columnFamilyName family1 2023-04-04 17:55:08,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6ff47725e297ecc75d44b4d159db9af8, ASSIGN in 527 msec 2023-04-04 17:55:08,779 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8cacce2752c642e19b04e52251f66f09 2023-04-04 17:55:08,786 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e39f6631c3a4bada81c47aeb22ddd21 2023-04-04 17:55:08,793 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-9a57cfb9ec4c4a21a7c494f71987a889 2023-04-04 17:55:08,800 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-b6e0163fc14148869c6ccae015583e55 2023-04-04 17:55:08,800 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(310): Store=74a0b5f9ac541529f0620ee3e73b0156/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:08,801 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,802 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2 2023-04-04 17:55:08,802 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2 2023-04-04 17:55:08,802 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a0b5f9ac541529f0620ee3e73b0156 columnFamilyName family2 2023-04-04 17:55:08,810 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-07a91df8b4184ce4926ec30a4bcf22b0 2023-04-04 17:55:08,816 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-1748b008902e450ca6f76dd015bbbabc 2023-04-04 17:55:08,822 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-40d9ed85cd1645acb38412ab48403ca0 2023-04-04 17:55:08,832 DEBUG [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e900dada18a42c3a6a71dbc6a3a79ad 2023-04-04 17:55:08,832 INFO [StoreOpener-74a0b5f9ac541529f0620ee3e73b0156-1] regionserver.HStore(310): Store=74a0b5f9ac541529f0620ee3e73b0156/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:08,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:08,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:55:08,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 74a0b5f9ac541529f0620ee3e73b0156; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60922004, jitterRate=-0.09219139814376831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:08,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:08,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156., pid=103, masterSystemTime=1680630908550 2023-04-04 17:55:08,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-04-04 17:55:08,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-04-04 17:55:08,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:08,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:08,841 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=74a0b5f9ac541529f0620ee3e73b0156, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:08,841 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680630908841"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630908841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630908841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630908841"}]},"ts":"1680630908841"} 2023-04-04 17:55:08,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-04 17:55:08,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-04-04 17:55:08,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 74a0b5f9ac541529f0620ee3e73b0156, server=jenkins-hbase17.apache.org,46251,1680630785259 in 442 msec 2023-04-04 17:55:08,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-04-04 17:55:08,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=74a0b5f9ac541529f0620ee3e73b0156, ASSIGN in 601 msec 2023-04-04 17:55:08,846 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630908845"}]},"ts":"1680630908845"} 2023-04-04 17:55:08,847 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-04-04 17:55:08,848 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-04-04 17:55:08,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 616 msec 2023-04-04 17:55:09,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-04 17:55:09,345 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-04-04 17:55:09,355 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:09,364 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:09,375 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:09,376 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:09,382 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-04 17:55:09,395 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-04-04 17:55:09,395 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:09,395 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(139): Connect 0x118ac2fc to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:55:09,398 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb6674a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:55:09,399 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:09,399 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:09,399 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:09,966 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family2/21e8273dd6ec4c388428bc8ec130524b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/21e8273dd6ec4c388428bc8ec130524b 2023-04-04 17:55:09,966 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/.tmp/family1/4cfb5edc520240bdb0a9f4f3246d186e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/4cfb5edc520240bdb0a9f4f3246d186e 2023-04-04 17:55:09,972 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-04-04 17:55:09,972 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-04-04 17:55:09,974 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a2a935adeee11188aab1d3e9831bfb11/family1 of a2a935adeee11188aab1d3e9831bfb11 into 4cfb5edc520240bdb0a9f4f3246d186e(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:09,974 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a2a935adeee11188aab1d3e9831bfb11/family2 of a2a935adeee11188aab1d3e9831bfb11 into 21e8273dd6ec4c388428bc8ec130524b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:09,974 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:09,974 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:09,974 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11., storeName=a2a935adeee11188aab1d3e9831bfb11/family1, priority=12, startTime=1680630908647; duration=1sec 2023-04-04 17:55:09,974 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11., storeName=a2a935adeee11188aab1d3e9831bfb11/family2, priority=12, startTime=1680630908648; duration=1sec 2023-04-04 17:55:09,975 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-04-04 17:55:09,975 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-04-04 17:55:09,975 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-04 17:55:09,976 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-04 17:55:09,979 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-04 17:55:09,979 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-04 17:55:09,979 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1912): 6ff47725e297ecc75d44b4d159db9af8/family1 is initiating minor compaction (all files) 2023-04-04 17:55:09,979 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1912): 74a0b5f9ac541529f0620ee3e73b0156/family2 is initiating minor compaction (all files) 2023-04-04 17:55:09,979 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6ff47725e297ecc75d44b4d159db9af8/family1 in testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:09,979 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 74a0b5f9ac541529f0620ee3e73b0156/family2 in testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:09,980 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f78ee851ef1b4aff997b9f5e9a0ee1fb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-475e3d7fe9824c9eb210cdfcce6452ac, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f535099c21134b7ea2c2a8ce3df5d654, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5873d4df722e453592e4dc912c68dc37] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp, totalSize=21.6 K 2023-04-04 17:55:09,980 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-1748b008902e450ca6f76dd015bbbabc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-40d9ed85cd1645acb38412ab48403ca0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-07a91df8b4184ce4926ec30a4bcf22b0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e900dada18a42c3a6a71dbc6a3a79ad] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp, totalSize=20.4 K 2023-04-04 17:55:09,980 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f78ee851ef1b4aff997b9f5e9a0ee1fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888032 2023-04-04 17:55:09,981 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-1748b008902e450ca6f76dd015bbbabc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888030 2023-04-04 17:55:09,981 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-475e3d7fe9824c9eb210cdfcce6452ac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:55:09,982 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-40d9ed85cd1645acb38412ab48403ca0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889492 2023-04-04 17:55:09,982 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f535099c21134b7ea2c2a8ce3df5d654, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:55:09,982 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-07a91df8b4184ce4926ec30a4bcf22b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:55:09,983 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5873d4df722e453592e4dc912c68dc37, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:09,983 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e900dada18a42c3a6a71dbc6a3a79ad, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:09,993 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] throttle.PressureAwareThroughputController(145): 74a0b5f9ac541529f0620ee3e73b0156#family2#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:09,994 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6ff47725e297ecc75d44b4d159db9af8#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:10,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-14ca5735b3714b0abf841c5ca9e0090a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-45174dda5ce14291987f01d60113f3c8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-f5f147bf268b4b3290dcbe1dc8b5fab6, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-c70a58d56195450ab099353e6d710155] to archive 2023-04-04 17:55:10,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:10,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-14ca5735b3714b0abf841c5ca9e0090a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-14ca5735b3714b0abf841c5ca9e0090a 2023-04-04 17:55:10,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-45174dda5ce14291987f01d60113f3c8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-45174dda5ce14291987f01d60113f3c8 2023-04-04 17:55:10,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-f5f147bf268b4b3290dcbe1dc8b5fab6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-f5f147bf268b4b3290dcbe1dc8b5fab6 2023-04-04 17:55:10,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-c70a58d56195450ab099353e6d710155 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-c70a58d56195450ab099353e6d710155 2023-04-04 17:55:10,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-d2419f86ce0c465aadac914d1f568abf, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-60c38c3347d444ba83850f4b1e43a5aa, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-905da60919a64529ab99e2d888482cfb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-73c1df600ff14b9a9a9f9effe69c3316] to archive 2023-04-04 17:55:10,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:10,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-d2419f86ce0c465aadac914d1f568abf to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-d2419f86ce0c465aadac914d1f568abf 2023-04-04 17:55:10,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-60c38c3347d444ba83850f4b1e43a5aa to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-60c38c3347d444ba83850f4b1e43a5aa 2023-04-04 17:55:10,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-905da60919a64529ab99e2d888482cfb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-905da60919a64529ab99e2d888482cfb 2023-04-04 17:55:10,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-73c1df600ff14b9a9a9f9effe69c3316 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family2/testCompactionWithHFileLink=a2a935adeee11188aab1d3e9831bfb11-73c1df600ff14b9a9a9f9effe69c3316 2023-04-04 17:55:10,283 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304042957cb12e970400c9546325948040052 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304042957cb12e970400c9546325948040052 2023-04-04 17:55:10,283 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304041160ba09a24d4043bd2ebcc9f6b7c9d0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304041160ba09a24d4043bd2ebcc9f6b7c9d0 2023-04-04 17:55:10,284 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040440fc3212313b457eab9617196ab4977c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040440fc3212313b457eab9617196ab4977c 2023-04-04 17:55:10,285 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:10,285 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:10,285 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:10,295 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:55:10,298 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:55:10,302 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:55:10,310 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:55:10,313 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:55:10,334 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/c9f676b01b694f15903480e929cadd18 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-04-04 17:55:10,339 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/c9f676b01b694f15903480e929cadd18}] 2023-04-04 17:55:10,346 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/57e4656d2f024100aeda03a1a07ebf44 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-04-04 17:55:10,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/c9f676b01b694f15903480e929cadd18 for inclusion in 74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:55:10,346 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/57e4656d2f024100aeda03a1a07ebf44}] 2023-04-04 17:55:10,349 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/b2e0a0ae39164646a2c494acf2f14612 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-04-04 17:55:10,350 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/b2e0a0ae39164646a2c494acf2f14612}] 2023-04-04 17:55:10,350 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/57e4656d2f024100aeda03a1a07ebf44 for inclusion in 6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:55:10,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-04-04 17:55:10,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last=1 2023-04-04 17:55:10,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:10,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404/family1/c9f676b01b694f15903480e929cadd18 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__m5dv5rm44tppp6jj2chprvah046ok2bu67u3e6pnbbep2pltdvglf2uahn00sec3/family1/c9f676b01b694f15903480e929cadd18 2023-04-04 17:55:10,351 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/b2e0a0ae39164646a2c494acf2f14612 for inclusion in a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:55:10,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-04-04 17:55:10,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-04 17:55:10,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:55:10,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__m5dv5rm44tppp6jj2chprvah046ok2bu67u3e6pnbbep2pltdvglf2uahn00sec3/family1/c9f676b01b694f15903480e929cadd18 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_ 2023-04-04 17:55:10,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__m5dv5rm44tppp6jj2chprvah046ok2bu67u3e6pnbbep2pltdvglf2uahn00sec3/family1/c9f676b01b694f15903480e929cadd18 into 74a0b5f9ac541529f0620ee3e73b0156/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_ - updating store file list. 2023-04-04 17:55:10,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404/family1/57e4656d2f024100aeda03a1a07ebf44 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__sol6njrsd10vo5gqblabshoqn98qdka5aee654r27rloe83m0npst72tgkni279/family1/57e4656d2f024100aeda03a1a07ebf44 2023-04-04 17:55:10,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-04-04 17:55:10,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-04 17:55:10,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:55:10,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404/family1/b2e0a0ae39164646a2c494acf2f14612 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__l2ridprhsq7dfk42ph7mbmnl288r796sbtv8cklhrb3csn4a0diovcm40ngjc2uj/family1/b2e0a0ae39164646a2c494acf2f14612 2023-04-04 17:55:10,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__sol6njrsd10vo5gqblabshoqn98qdka5aee654r27rloe83m0npst72tgkni279/family1/57e4656d2f024100aeda03a1a07ebf44 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/3e8ce2ce7cf24c1baec798b65444c7b5_SeqId_34_ 2023-04-04 17:55:10,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__sol6njrsd10vo5gqblabshoqn98qdka5aee654r27rloe83m0npst72tgkni279/family1/57e4656d2f024100aeda03a1a07ebf44 into 6ff47725e297ecc75d44b4d159db9af8/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/3e8ce2ce7cf24c1baec798b65444c7b5_SeqId_34_ - updating store file list. 2023-04-04 17:55:10,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_ into 74a0b5f9ac541529f0620ee3e73b0156/family1 2023-04-04 17:55:10,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__m5dv5rm44tppp6jj2chprvah046ok2bu67u3e6pnbbep2pltdvglf2uahn00sec3/family1/c9f676b01b694f15903480e929cadd18 into 74a0b5f9ac541529f0620ee3e73b0156/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_) 2023-04-04 17:55:10,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__l2ridprhsq7dfk42ph7mbmnl288r796sbtv8cklhrb3csn4a0diovcm40ngjc2uj/family1/b2e0a0ae39164646a2c494acf2f14612 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f84315afbe3842619160134281f3b751_SeqId_36_ 2023-04-04 17:55:10,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__m5dv5rm44tppp6jj2chprvah046ok2bu67u3e6pnbbep2pltdvglf2uahn00sec3/family1/c9f676b01b694f15903480e929cadd18 2023-04-04 17:55:10,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:10,356 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__l2ridprhsq7dfk42ph7mbmnl288r796sbtv8cklhrb3csn4a0diovcm40ngjc2uj/family1/b2e0a0ae39164646a2c494acf2f14612 into a2a935adeee11188aab1d3e9831bfb11/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f84315afbe3842619160134281f3b751_SeqId_36_ - updating store file list. 2023-04-04 17:55:10,358 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/3e8ce2ce7cf24c1baec798b65444c7b5_SeqId_34_ into 6ff47725e297ecc75d44b4d159db9af8/family1 2023-04-04 17:55:10,358 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__sol6njrsd10vo5gqblabshoqn98qdka5aee654r27rloe83m0npst72tgkni279/family1/57e4656d2f024100aeda03a1a07ebf44 into 6ff47725e297ecc75d44b4d159db9af8/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/3e8ce2ce7cf24c1baec798b65444c7b5_SeqId_34_) 2023-04-04 17:55:10,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__sol6njrsd10vo5gqblabshoqn98qdka5aee654r27rloe83m0npst72tgkni279/family1/57e4656d2f024100aeda03a1a07ebf44 2023-04-04 17:55:10,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-04-04 17:55:10,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.HStore(1912): 74a0b5f9ac541529f0620ee3e73b0156/family1 is initiating minor compaction (all files) 2023-04-04 17:55:10,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1efcaf26; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-04-04 17:55:10,359 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f84315afbe3842619160134281f3b751_SeqId_36_ into a2a935adeee11188aab1d3e9831bfb11/family1 2023-04-04 17:55:10,360 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__l2ridprhsq7dfk42ph7mbmnl288r796sbtv8cklhrb3csn4a0diovcm40ngjc2uj/family1/b2e0a0ae39164646a2c494acf2f14612 into a2a935adeee11188aab1d3e9831bfb11/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/family1/f84315afbe3842619160134281f3b751_SeqId_36_) 2023-04-04 17:55:10,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testCompactionWithHFileLink__l2ridprhsq7dfk42ph7mbmnl288r796sbtv8cklhrb3csn4a0diovcm40ngjc2uj/family1/b2e0a0ae39164646a2c494acf2f14612 2023-04-04 17:55:10,360 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:10,361 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:10,361 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:10,362 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:10,363 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:10,363 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202304040be93e5c902042b7b8b0fbcdf0a9f928 2023-04-04 17:55:10,363 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:10,364 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023040416ba177da31640b6802112c63549bd6a 2023-04-04 17:55:10,366 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202304044a66ff8c747640c2911328f0a5f35862 2023-04-04 17:55:10,366 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023040431b9eab461814dee880d23d2119ae150 2023-04-04 17:55:10,366 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230404a83b7a8fda29404c8cb9515620e96c21 2023-04-04 17:55:10,367 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202304046680ea4eecc1440383e64f187678d4e3 2023-04-04 17:55:10,367 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230404ee7eaa04d66d4f41a3a7feb8cef7ae43 2023-04-04 17:55:10,367 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-04 17:55:10,367 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230404' 2023-04-04 17:55:10,368 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304044dc8095b258843599a9555f8c9701888 2023-04-04 17:55:10,368 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:10,368 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023040470783ba84b814faf9d0055d14511ae12 2023-04-04 17:55:10,368 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230404aa186c06bdd148008080876ae5d5f64a 2023-04-04 17:55:10,368 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-04 17:55:10,369 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304048ce0df9d94a942ea92a9b0ffe624fb69 2023-04-04 17:55:10,369 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230404' 2023-04-04 17:55:10,369 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:10,369 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230404ffd93621eabb4b2aa6a4344ad3af143a 2023-04-04 17:55:10,369 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-04 17:55:10,369 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230404' 2023-04-04 17:55:10,370 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230404 for table='testCompactionWithHFileLink' and column='family1' 2023-04-04 17:55:10,370 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-04-04 17:55:10,372 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:10,374 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:10,378 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:10,380 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:10,386 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:10,386 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:10,401 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=284 (was 252) - Thread LEAK? -, OpenFileDescriptor=753 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 103) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6701 (was 7840) 2023-04-04 17:55:10,413 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=284, OpenFileDescriptor=757, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=175, AvailableMemoryMB=6701 2023-04-04 17:55:10,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.HMaster$15(3014): Client=jenkins//136.243.18.41 creating {NAME => 'ns'} 2023-04-04 17:55:10,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-04-04 17:55:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-04-04 17:55:10,425 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-04-04 17:55:10,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-04-04 17:55:10,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-04-04 17:55:10,527 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-04 17:55:10,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-04-04 17:55:10,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:55:10,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-04-04 17:55:10,530 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:55:10,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-04 17:55:10,533 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:10,533 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:10,533 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:10,533 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47 empty. 2023-04-04 17:55:10,533 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7 empty. 2023-04-04 17:55:10,533 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004 empty. 2023-04-04 17:55:10,534 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:10,534 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:10,534 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:10,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-04-04 17:55:10,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-04 17:55:10,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-04 17:55:10,947 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-04-04 17:55:10,950 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => ded5805e4cf2c574f015d9078347dd47, NAME => 'ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:55:10,951 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0db0bdf042cc13ea77afe716fe561004, NAME => 'ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:55:10,952 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 935b30f108e870c49ac470cb0ed88be7, NAME => 'ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:55:11,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-04 17:55:11,224 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family1/227c6178f2ec4f36957d6b0cab63610e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/227c6178f2ec4f36957d6b0cab63610e 2023-04-04 17:55:11,224 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family2/3be919604d7e49ed8fb520343877c3df as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/3be919604d7e49ed8fb520343877c3df 2023-04-04 17:55:11,228 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6ff47725e297ecc75d44b4d159db9af8/family1 of 6ff47725e297ecc75d44b4d159db9af8 into 227c6178f2ec4f36957d6b0cab63610e(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:11,228 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 74a0b5f9ac541529f0620ee3e73b0156/family2 of 74a0b5f9ac541529f0620ee3e73b0156 into 3be919604d7e49ed8fb520343877c3df(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:11,228 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8., storeName=6ff47725e297ecc75d44b4d159db9af8/family1, priority=12, startTime=1680630908766; duration=1sec 2023-04-04 17:55:11,228 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156., storeName=74a0b5f9ac541529f0620ee3e73b0156/family2, priority=12, startTime=1680630908840; duration=1sec 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-04-04 17:55:11,228 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 74a0b5f9ac541529f0620ee3e73b0156/family1 in testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. because compaction request was cancelled 2023-04-04 17:55:11,228 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e39f6631c3a4bada81c47aeb22ddd21, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8cacce2752c642e19b04e52251f66f09, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-b6e0163fc14148869c6ccae015583e55, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-9a57cfb9ec4c4a21a7c494f71987a889, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp, totalSize=28.9 K 2023-04-04 17:55:11,228 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-04 17:55:11,229 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e39f6631c3a4bada81c47aeb22ddd21, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888030 2023-04-04 17:55:11,230 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8cacce2752c642e19b04e52251f66f09, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889492 2023-04-04 17:55:11,230 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-b6e0163fc14148869c6ccae015583e55, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:55:11,231 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-04 17:55:11,231 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-9a57cfb9ec4c4a21a7c494f71987a889, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:11,231 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1912): 6ff47725e297ecc75d44b4d159db9af8/family2 is initiating minor compaction (all files) 2023-04-04 17:55:11,231 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 6ff47725e297ecc75d44b4d159db9af8/family2 in testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:55:11,231 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 8e6c4d9003bd46479d5b41ead9524176_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1680630888030 2023-04-04 17:55:11,231 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5cbf6586996047a38a914b91eeb94ce5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-45d38c8f13f44763a8b747a17457d570, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-9353233eda0e4195b7b11c338329f5b7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-95922578f8184b82bfea32731ccbfe2e] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp, totalSize=20.4 K 2023-04-04 17:55:11,231 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5cbf6586996047a38a914b91eeb94ce5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630888032 2023-04-04 17:55:11,232 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-45d38c8f13f44763a8b747a17457d570, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630889493 2023-04-04 17:55:11,232 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-9353233eda0e4195b7b11c338329f5b7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630890919 2023-04-04 17:55:11,233 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-95922578f8184b82bfea32731ccbfe2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630892710 2023-04-04 17:55:11,243 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): 74a0b5f9ac541529f0620ee3e73b0156#family1#compaction#118 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:11,248 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] throttle.PressureAwareThroughputController(145): 6ff47725e297ecc75d44b4d159db9af8#family2#compaction#119 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:11,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f78ee851ef1b4aff997b9f5e9a0ee1fb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-475e3d7fe9824c9eb210cdfcce6452ac, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f535099c21134b7ea2c2a8ce3df5d654, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5873d4df722e453592e4dc912c68dc37] to archive 2023-04-04 17:55:11,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:11,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f78ee851ef1b4aff997b9f5e9a0ee1fb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f78ee851ef1b4aff997b9f5e9a0ee1fb 2023-04-04 17:55:11,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-475e3d7fe9824c9eb210cdfcce6452ac to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-475e3d7fe9824c9eb210cdfcce6452ac 2023-04-04 17:55:11,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f535099c21134b7ea2c2a8ce3df5d654 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-f535099c21134b7ea2c2a8ce3df5d654 2023-04-04 17:55:11,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5873d4df722e453592e4dc912c68dc37 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family1/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5873d4df722e453592e4dc912c68dc37 2023-04-04 17:55:11,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-1748b008902e450ca6f76dd015bbbabc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-40d9ed85cd1645acb38412ab48403ca0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-07a91df8b4184ce4926ec30a4bcf22b0, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e900dada18a42c3a6a71dbc6a3a79ad] to archive 2023-04-04 17:55:11,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:11,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-1748b008902e450ca6f76dd015bbbabc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-1748b008902e450ca6f76dd015bbbabc 2023-04-04 17:55:11,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-40d9ed85cd1645acb38412ab48403ca0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-40d9ed85cd1645acb38412ab48403ca0 2023-04-04 17:55:11,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-07a91df8b4184ce4926ec30a4bcf22b0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-07a91df8b4184ce4926ec30a4bcf22b0 2023-04-04 17:55:11,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e900dada18a42c3a6a71dbc6a3a79ad to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family2/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e900dada18a42c3a6a71dbc6a3a79ad 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 935b30f108e870c49ac470cb0ed88be7, disabling compactions & flushes 2023-04-04 17:55:11,361 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. after waiting 0 ms 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 0db0bdf042cc13ea77afe716fe561004, disabling compactions & flushes 2023-04-04 17:55:11,361 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:11,361 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:11,361 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. after waiting 0 ms 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:11,362 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing ded5805e4cf2c574f015d9078347dd47, disabling compactions & flushes 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:11,362 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. after waiting 0 ms 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:11,362 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:11,362 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:11,364 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:55:11,364 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680630911364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630911364"}]},"ts":"1680630911364"} 2023-04-04 17:55:11,364 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680630911364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630911364"}]},"ts":"1680630911364"} 2023-04-04 17:55:11,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680630911364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630911364"}]},"ts":"1680630911364"} 2023-04-04 17:55:11,366 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-04 17:55:11,367 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:55:11,367 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630911367"}]},"ts":"1680630911367"} 2023-04-04 17:55:11,368 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-04-04 17:55:11,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ded5805e4cf2c574f015d9078347dd47, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=935b30f108e870c49ac470cb0ed88be7, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0db0bdf042cc13ea77afe716fe561004, ASSIGN}] 2023-04-04 17:55:11,371 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=935b30f108e870c49ac470cb0ed88be7, ASSIGN 2023-04-04 17:55:11,372 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0db0bdf042cc13ea77afe716fe561004, ASSIGN 2023-04-04 17:55:11,372 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ded5805e4cf2c574f015d9078347dd47, ASSIGN 2023-04-04 17:55:11,372 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0db0bdf042cc13ea77afe716fe561004, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:55:11,372 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=935b30f108e870c49ac470cb0ed88be7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:55:11,372 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ded5805e4cf2c574f015d9078347dd47, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:55:11,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ded5805e4cf2c574f015d9078347dd47, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:11,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=935b30f108e870c49ac470cb0ed88be7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:11,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=0db0bdf042cc13ea77afe716fe561004, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:11,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680630911525"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630911525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630911525"}]},"ts":"1680630911525"} 2023-04-04 17:55:11,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680630911525"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630911525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630911525"}]},"ts":"1680630911525"} 2023-04-04 17:55:11,525 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680630911525"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630911525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630911525"}]},"ts":"1680630911525"} 2023-04-04 17:55:11,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure ded5805e4cf2c574f015d9078347dd47, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:11,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 0db0bdf042cc13ea77afe716fe561004, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:11,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 935b30f108e870c49ac470cb0ed88be7, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:11,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-04 17:55:11,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:11,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 935b30f108e870c49ac470cb0ed88be7, NAME => 'ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7.', STARTKEY => '1', ENDKEY => '2'} 2023-04-04 17:55:11,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:11,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,682 INFO [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,683 DEBUG [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1 2023-04-04 17:55:11,683 DEBUG [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1 2023-04-04 17:55:11,683 INFO [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 935b30f108e870c49ac470cb0ed88be7 columnFamilyName family1 2023-04-04 17:55:11,684 INFO [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] regionserver.HStore(310): Store=935b30f108e870c49ac470cb0ed88be7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:11,684 INFO [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,686 DEBUG [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2 2023-04-04 17:55:11,686 DEBUG [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2 2023-04-04 17:55:11,686 INFO [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 935b30f108e870c49ac470cb0ed88be7 columnFamilyName family2 2023-04-04 17:55:11,687 INFO [StoreOpener-935b30f108e870c49ac470cb0ed88be7-1] regionserver.HStore(310): Store=935b30f108e870c49ac470cb0ed88be7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:11,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:11,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:55:11,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:55:11,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 935b30f108e870c49ac470cb0ed88be7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72834692, jitterRate=0.08532148599624634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:11,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7., pid=111, masterSystemTime=1680630911678 2023-04-04 17:55:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:11,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:11,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:11,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=935b30f108e870c49ac470cb0ed88be7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ded5805e4cf2c574f015d9078347dd47, NAME => 'ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47.', STARTKEY => '', ENDKEY => '1'} 2023-04-04 17:55:11,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680630911703"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630911703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630911703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630911703"}]},"ts":"1680630911703"} 2023-04-04 17:55:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,704 INFO [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,706 DEBUG [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1 2023-04-04 17:55:11,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-04-04 17:55:11,706 DEBUG [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1 2023-04-04 17:55:11,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 935b30f108e870c49ac470cb0ed88be7, server=jenkins-hbase17.apache.org,46251,1680630785259 in 175 msec 2023-04-04 17:55:11,706 INFO [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ded5805e4cf2c574f015d9078347dd47 columnFamilyName family1 2023-04-04 17:55:11,707 INFO [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] regionserver.HStore(310): Store=ded5805e4cf2c574f015d9078347dd47/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:11,707 INFO [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,709 DEBUG [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2 2023-04-04 17:55:11,709 DEBUG [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2 2023-04-04 17:55:11,709 INFO [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ded5805e4cf2c574f015d9078347dd47 columnFamilyName family2 2023-04-04 17:55:11,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=935b30f108e870c49ac470cb0ed88be7, ASSIGN in 336 msec 2023-04-04 17:55:11,710 INFO [StoreOpener-ded5805e4cf2c574f015d9078347dd47-1] regionserver.HStore(310): Store=ded5805e4cf2c574f015d9078347dd47/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:11,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:11,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:55:11,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ded5805e4cf2c574f015d9078347dd47; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62543490, jitterRate=-0.06802937388420105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:11,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47., pid=109, masterSystemTime=1680630911678 2023-04-04 17:55:11,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:11,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:11,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:11,718 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ded5805e4cf2c574f015d9078347dd47, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:11,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0db0bdf042cc13ea77afe716fe561004, NAME => 'ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004.', STARTKEY => '2', ENDKEY => ''} 2023-04-04 17:55:11,718 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680630911718"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630911718"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630911718"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630911718"}]},"ts":"1680630911718"} 2023-04-04 17:55:11,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:11,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,720 INFO [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-04-04 17:55:11,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure ded5805e4cf2c574f015d9078347dd47, server=jenkins-hbase17.apache.org,46251,1680630785259 in 193 msec 2023-04-04 17:55:11,721 DEBUG [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1 2023-04-04 17:55:11,721 DEBUG [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1 2023-04-04 17:55:11,721 INFO [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0db0bdf042cc13ea77afe716fe561004 columnFamilyName family1 2023-04-04 17:55:11,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ded5805e4cf2c574f015d9078347dd47, ASSIGN in 351 msec 2023-04-04 17:55:11,722 INFO [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] regionserver.HStore(310): Store=0db0bdf042cc13ea77afe716fe561004/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:11,722 INFO [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,723 DEBUG [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2 2023-04-04 17:55:11,724 DEBUG [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2 2023-04-04 17:55:11,724 INFO [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0db0bdf042cc13ea77afe716fe561004 columnFamilyName family2 2023-04-04 17:55:11,725 INFO [StoreOpener-0db0bdf042cc13ea77afe716fe561004-1] regionserver.HStore(310): Store=0db0bdf042cc13ea77afe716fe561004/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:11,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:11,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:55:11,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0db0bdf042cc13ea77afe716fe561004; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71662853, jitterRate=0.0678597241640091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:11,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004., pid=110, masterSystemTime=1680630911678 2023-04-04 17:55:11,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:11,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:11,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=0db0bdf042cc13ea77afe716fe561004, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:11,731 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680630911731"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630911731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630911731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630911731"}]},"ts":"1680630911731"} 2023-04-04 17:55:11,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-04-04 17:55:11,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 0db0bdf042cc13ea77afe716fe561004, server=jenkins-hbase17.apache.org,46251,1680630785259 in 205 msec 2023-04-04 17:55:11,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-04-04 17:55:11,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0db0bdf042cc13ea77afe716fe561004, ASSIGN in 363 msec 2023-04-04 17:55:11,735 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:55:11,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630911735"}]},"ts":"1680630911735"} 2023-04-04 17:55:11,736 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-04-04 17:55:11,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:55:11,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2110 sec 2023-04-04 17:55:12,079 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/.tmp/family2/8fd59e94a8d34679bcd56106913bb3d2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/8fd59e94a8d34679bcd56106913bb3d2 2023-04-04 17:55:12,084 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6ff47725e297ecc75d44b4d159db9af8/family2 of 6ff47725e297ecc75d44b4d159db9af8 into 8fd59e94a8d34679bcd56106913bb3d2(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:12,085 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:55:12,085 INFO [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8., storeName=6ff47725e297ecc75d44b4d159db9af8/family2, priority=12, startTime=1680630908766; duration=0sec 2023-04-04 17:55:12,085 DEBUG [RS:0;jenkins-hbase17:46251-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:55:12,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5cbf6586996047a38a914b91eeb94ce5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-45d38c8f13f44763a8b747a17457d570, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-9353233eda0e4195b7b11c338329f5b7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-95922578f8184b82bfea32731ccbfe2e] to archive 2023-04-04 17:55:12,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:12,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5cbf6586996047a38a914b91eeb94ce5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-5cbf6586996047a38a914b91eeb94ce5 2023-04-04 17:55:12,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-45d38c8f13f44763a8b747a17457d570 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-45d38c8f13f44763a8b747a17457d570 2023-04-04 17:55:12,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-9353233eda0e4195b7b11c338329f5b7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-9353233eda0e4195b7b11c338329f5b7 2023-04-04 17:55:12,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-95922578f8184b82bfea32731ccbfe2e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/family2/testCompactionWithHFileLink=6ff47725e297ecc75d44b4d159db9af8-95922578f8184b82bfea32731ccbfe2e 2023-04-04 17:55:12,479 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/.tmp/family1/1de0b57c2691497a8f901adb1290d9c8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/1de0b57c2691497a8f901adb1290d9c8 2023-04-04 17:55:12,487 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 74a0b5f9ac541529f0620ee3e73b0156/family1 of 74a0b5f9ac541529f0620ee3e73b0156 into 1de0b57c2691497a8f901adb1290d9c8(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:12,487 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:55:12,487 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1680630910359; duration=1sec 2023-04-04 17:55:12,488 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:55:12,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e39f6631c3a4bada81c47aeb22ddd21, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8cacce2752c642e19b04e52251f66f09, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-b6e0163fc14148869c6ccae015583e55, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-9a57cfb9ec4c4a21a7c494f71987a889, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_] to archive 2023-04-04 17:55:12,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:12,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e39f6631c3a4bada81c47aeb22ddd21 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8e39f6631c3a4bada81c47aeb22ddd21 2023-04-04 17:55:12,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8cacce2752c642e19b04e52251f66f09 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-8cacce2752c642e19b04e52251f66f09 2023-04-04 17:55:12,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-b6e0163fc14148869c6ccae015583e55 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-b6e0163fc14148869c6ccae015583e55 2023-04-04 17:55:12,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-9a57cfb9ec4c4a21a7c494f71987a889 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/testCompactionWithHFileLink=74a0b5f9ac541529f0620ee3e73b0156-9a57cfb9ec4c4a21a7c494f71987a889 2023-04-04 17:55:12,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/family1/8e6c4d9003bd46479d5b41ead9524176_SeqId_34_ 2023-04-04 17:55:12,574 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-04-04 17:55:12,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-04 17:55:12,640 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-04-04 17:55:12,652 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:12,653 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:12,653 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:12,656 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:12,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-04 17:55:12,659 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-04 17:55:12,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:12,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-04 17:55:12,659 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-04 17:55:12,660 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:12,660 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:12,661 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:12,661 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:12,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:12,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:12,662 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:12,662 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:12,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:12,663 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-04 17:55:12,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-04 17:55:12,664 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-04 17:55:12,664 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:12,664 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-04 17:55:12,664 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:12,664 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. started... 2023-04-04 17:55:12,665 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:12,665 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:12,667 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. started... 2023-04-04 17:55:12,664 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:12,667 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 935b30f108e870c49ac470cb0ed88be7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:55:12,665 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:12,667 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0db0bdf042cc13ea77afe716fe561004 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:55:12,667 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. started... 2023-04-04 17:55:12,668 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ded5805e4cf2c574f015d9078347dd47 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:55:13,086 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404a137d6d3634c47238ceba29d1d019539 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230404a137d6d3634c47238ceba29d1d019539 2023-04-04 17:55:13,087 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304040826ece789f041f3bd4f86dfac221e73 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304040826ece789f041f3bd4f86dfac221e73 2023-04-04 17:55:13,087 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404f8c9009840da44bfb93e6ad58cd11e35 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230404f8c9009840da44bfb93e6ad58cd11e35 2023-04-04 17:55:13,496 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/81f5121727284fee961cbab4eea96966 2023-04-04 17:55:13,497 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/2f39c09aa8d54b1ca5b19b2e42f71453 2023-04-04 17:55:13,501 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/00474f2b35df4a399701c6204305b62b 2023-04-04 17:55:13,927 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040465000e46a2314eeeab7b2d348dbf66ac to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023040465000e46a2314eeeab7b2d348dbf66ac 2023-04-04 17:55:13,927 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404fedae68f7fb9464db4abb042e30fb66e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230404fedae68f7fb9464db4abb042e30fb66e 2023-04-04 17:55:13,930 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304040c641db9e88041eda84a4d808331783e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202304040c641db9e88041eda84a4d808331783e 2023-04-04 17:55:13,936 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/0958637a10104d5eb98fe9498a9fecd7 2023-04-04 17:55:13,940 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/00474f2b35df4a399701c6204305b62b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/00474f2b35df4a399701c6204305b62b 2023-04-04 17:55:13,944 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/00474f2b35df4a399701c6204305b62b, entries=4, sequenceid=5, filesize=5.4 K 2023-04-04 17:55:13,944 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/0958637a10104d5eb98fe9498a9fecd7 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0958637a10104d5eb98fe9498a9fecd7 2023-04-04 17:55:13,948 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0958637a10104d5eb98fe9498a9fecd7, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:55:13,949 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ded5805e4cf2c574f015d9078347dd47 in 1281ms, sequenceid=5, compaction requested=false 2023-04-04 17:55:13,949 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:13,949 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:13,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:14,334 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/a8fd7613e36747f0a1349643851f8b28 2023-04-04 17:55:14,334 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/3bc061260bfb40e8a9b6f0545833f22b 2023-04-04 17:55:14,345 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/81f5121727284fee961cbab4eea96966 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/81f5121727284fee961cbab4eea96966 2023-04-04 17:55:14,345 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/2f39c09aa8d54b1ca5b19b2e42f71453 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/2f39c09aa8d54b1ca5b19b2e42f71453 2023-04-04 17:55:14,350 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/81f5121727284fee961cbab4eea96966, entries=4, sequenceid=5, filesize=5.4 K 2023-04-04 17:55:14,350 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/2f39c09aa8d54b1ca5b19b2e42f71453, entries=4, sequenceid=5, filesize=5.4 K 2023-04-04 17:55:14,351 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/3bc061260bfb40e8a9b6f0545833f22b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/3bc061260bfb40e8a9b6f0545833f22b 2023-04-04 17:55:14,352 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/a8fd7613e36747f0a1349643851f8b28 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/a8fd7613e36747f0a1349643851f8b28 2023-04-04 17:55:14,356 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/3bc061260bfb40e8a9b6f0545833f22b, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:55:14,356 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/a8fd7613e36747f0a1349643851f8b28, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:55:14,357 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 935b30f108e870c49ac470cb0ed88be7 in 1690ms, sequenceid=5, compaction requested=false 2023-04-04 17:55:14,357 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0db0bdf042cc13ea77afe716fe561004 in 1690ms, sequenceid=5, compaction requested=false 2023-04-04 17:55:14,357 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:14,357 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:14,357 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:14,357 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:14,357 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:14,357 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:14,357 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:14,357 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,357 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-04 17:55:14,358 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-04 17:55:14,359 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,359 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:14,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:14,359 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,359 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:14,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:14,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-04 17:55:14,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3abe3322[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:14,361 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-04 17:55:14,361 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,362 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,362 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-04 17:55:14,362 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,362 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:14,362 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-04 17:55:14,362 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:14,363 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-04 17:55:14,363 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:14,363 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,363 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-04 17:55:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:14,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:14,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:14,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:14,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:14,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:14,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-04 17:55:14,366 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-04 17:55:14,366 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:14,366 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:14,366 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-04 17:55:14,366 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:14,367 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,367 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:14,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:14,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,367 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:14,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:14,368 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:14,369 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:14,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,370 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,370 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:14,370 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:14,371 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-04 17:55:14,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:14,370 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:14,371 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:14,371 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,371 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:14,371 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:14,371 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:14,371 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:14,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:14,371 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-04 17:55:14,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:14,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:14,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:14,471 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:14,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:14,474 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:14,475 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:14,475 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:14,479 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-04 17:55:14,482 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-04 17:55:14,482 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:14,482 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-04 17:55:14,482 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-04 17:55:14,483 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,483 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:14,484 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:14,484 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:14,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:14,485 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:14,485 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:14,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:14,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:14,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:14,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:14,487 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-04 17:55:14,488 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-04 17:55:14,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-04 17:55:14,488 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-04 17:55:14,488 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:14,488 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-04 17:55:14,489 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:14,489 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. started... 2023-04-04 17:55:14,489 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:14,489 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:14,489 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:14,489 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 935b30f108e870c49ac470cb0ed88be7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:55:14,489 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:14,489 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. started... 2023-04-04 17:55:14,490 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. started... 2023-04-04 17:55:14,490 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ded5805e4cf2c574f015d9078347dd47 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:55:14,490 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0db0bdf042cc13ea77afe716fe561004 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:55:14,909 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404c8967b1e1e4c4ba1865abee4ca671c36 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230404c8967b1e1e4c4ba1865abee4ca671c36 2023-04-04 17:55:14,909 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304042b032ef7a913457e9964215e881ad79a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304042b032ef7a913457e9964215e881ad79a 2023-04-04 17:55:14,911 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404935ae2c92abb4c13bab05fea0bcc7dfd to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230404935ae2c92abb4c13bab05fea0bcc7dfd 2023-04-04 17:55:15,321 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/b7677ca1e1ec4485bd025aec4adbeeb4 2023-04-04 17:55:15,321 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/c8057a897bc54d90b9453d8a04facead 2023-04-04 17:55:15,322 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/ba422a5ce0e74836a37374f2f0127ac3 2023-04-04 17:55:15,750 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404d00937dc597c469db70ef8fd162bbe3e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230404d00937dc597c469db70ef8fd162bbe3e 2023-04-04 17:55:15,750 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040448adfae3ac0e4b38a7011d8258b64314 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023040448adfae3ac0e4b38a7011d8258b64314 2023-04-04 17:55:15,750 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404a4d8b584cfd04075b3a473d7c397d031 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230404a4d8b584cfd04075b3a473d7c397d031 2023-04-04 17:55:16,159 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/303aaa4cbfbb4977b71e31fa8d5f9f50 2023-04-04 17:55:16,159 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/9bfada831c5e4abca533553608d7f129 2023-04-04 17:55:16,159 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/8221bdf183464d48babe07167854a7ab 2023-04-04 17:55:16,169 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/c8057a897bc54d90b9453d8a04facead as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/c8057a897bc54d90b9453d8a04facead 2023-04-04 17:55:16,169 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/ba422a5ce0e74836a37374f2f0127ac3 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/ba422a5ce0e74836a37374f2f0127ac3 2023-04-04 17:55:16,173 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/ba422a5ce0e74836a37374f2f0127ac3, entries=4, sequenceid=9, filesize=5.4 K 2023-04-04 17:55:16,173 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/c8057a897bc54d90b9453d8a04facead, entries=4, sequenceid=9, filesize=5.4 K 2023-04-04 17:55:16,173 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/b7677ca1e1ec4485bd025aec4adbeeb4 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/b7677ca1e1ec4485bd025aec4adbeeb4 2023-04-04 17:55:16,174 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/8221bdf183464d48babe07167854a7ab as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/8221bdf183464d48babe07167854a7ab 2023-04-04 17:55:16,174 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/303aaa4cbfbb4977b71e31fa8d5f9f50 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/303aaa4cbfbb4977b71e31fa8d5f9f50 2023-04-04 17:55:16,177 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/b7677ca1e1ec4485bd025aec4adbeeb4, entries=4, sequenceid=9, filesize=5.4 K 2023-04-04 17:55:16,178 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/8221bdf183464d48babe07167854a7ab, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:55:16,179 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/303aaa4cbfbb4977b71e31fa8d5f9f50, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:55:16,179 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/9bfada831c5e4abca533553608d7f129 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/9bfada831c5e4abca533553608d7f129 2023-04-04 17:55:16,179 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0db0bdf042cc13ea77afe716fe561004 in 1689ms, sequenceid=9, compaction requested=false 2023-04-04 17:55:16,179 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:16,179 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ded5805e4cf2c574f015d9078347dd47 in 1689ms, sequenceid=9, compaction requested=false 2023-04-04 17:55:16,179 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:16,180 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:16,180 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:16,180 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:16,180 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:16,183 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/9bfada831c5e4abca533553608d7f129, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:55:16,184 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 935b30f108e870c49ac470cb0ed88be7 in 1695ms, sequenceid=9, compaction requested=false 2023-04-04 17:55:16,184 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:16,184 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:16,184 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:16,184 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:16,184 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,184 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-04 17:55:16,184 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-04 17:55:16,186 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,186 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:16,187 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,187 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:16,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-04 17:55:16,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d2c62c[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:16,188 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-04 17:55:16,188 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,188 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,188 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-04 17:55:16,189 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,189 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:16,189 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-04 17:55:16,189 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:16,189 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-04 17:55:16,189 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:16,189 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,189 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-04 17:55:16,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:16,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:16,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:16,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:16,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-04 17:55:16,192 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-04 17:55:16,192 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:16,192 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:16,192 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-04 17:55:16,192 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:16,193 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,193 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,193 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:16,193 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:16,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:16,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:16,194 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:16,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:16,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:16,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:16,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:16,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-04 17:55:16,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:16,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:16,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:16,196 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:16,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:16,196 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,197 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:16,197 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,297 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:16,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:16,299 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:16,299 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:16,299 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:16,303 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:16,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:16,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-04 17:55:16,306 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-04 17:55:16,306 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:16,306 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-04 17:55:16,306 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-04 17:55:16,307 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,307 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:16,308 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:16,308 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:16,309 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:16,309 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:16,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:16,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:16,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:16,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:16,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-04 17:55:16,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-04 17:55:16,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-04 17:55:16,312 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-04 17:55:16,312 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:16,312 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-04 17:55:16,312 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:16,312 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. started... 2023-04-04 17:55:16,312 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:16,312 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 935b30f108e870c49ac470cb0ed88be7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:55:16,312 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:16,313 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:16,312 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:16,313 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. started... 2023-04-04 17:55:16,312 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. started... 2023-04-04 17:55:16,313 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0db0bdf042cc13ea77afe716fe561004 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:55:16,313 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ded5805e4cf2c574f015d9078347dd47 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:55:16,729 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404b30a1b506fe84d6e873a6ad0262a48fd to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230404b30a1b506fe84d6e873a6ad0262a48fd 2023-04-04 17:55:16,732 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040484b07ac1c8b94c6084bf4268d761b491 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023040484b07ac1c8b94c6084bf4268d761b491 2023-04-04 17:55:16,732 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304041a92dfe9e11a45afae44955fd8bad430 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304041a92dfe9e11a45afae44955fd8bad430 2023-04-04 17:55:17,137 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/d5c9d23ad69a4ed0ac57a11830c170b2 2023-04-04 17:55:17,138 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/c2b2024cf74046a8bd7e7961941bbb8f 2023-04-04 17:55:17,141 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/477a5431b54740359dd0d1198f4030d8 2023-04-04 17:55:17,185 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:55:17,567 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304049344b5ec874d4bf3a1914767d2360f12 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202304049344b5ec874d4bf3a1914767d2360f12 2023-04-04 17:55:17,567 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404cfdd8f3ee9094d798b98c4a930e0f506 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230404cfdd8f3ee9094d798b98c4a930e0f506 2023-04-04 17:55:17,567 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404dc0222657f064e429f432dbca942f6f0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230404dc0222657f064e429f432dbca942f6f0 2023-04-04 17:55:17,571 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/c6012d20f16740248bbb55dab9256650 2023-04-04 17:55:17,574 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/c2b2024cf74046a8bd7e7961941bbb8f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/c2b2024cf74046a8bd7e7961941bbb8f 2023-04-04 17:55:17,577 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/c2b2024cf74046a8bd7e7961941bbb8f, entries=4, sequenceid=13, filesize=5.4 K 2023-04-04 17:55:17,577 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/c6012d20f16740248bbb55dab9256650 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c6012d20f16740248bbb55dab9256650 2023-04-04 17:55:17,581 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c6012d20f16740248bbb55dab9256650, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:55:17,582 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0db0bdf042cc13ea77afe716fe561004 in 1269ms, sequenceid=13, compaction requested=true 2023-04-04 17:55:17,582 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:17,582 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:17,582 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:17,972 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/0335ad488f3c462fbdfb3f62678e668b 2023-04-04 17:55:17,972 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/5636a2fbc29f4b1fb8cfd24ae8242506 2023-04-04 17:55:17,982 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/d5c9d23ad69a4ed0ac57a11830c170b2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/d5c9d23ad69a4ed0ac57a11830c170b2 2023-04-04 17:55:17,983 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/477a5431b54740359dd0d1198f4030d8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/477a5431b54740359dd0d1198f4030d8 2023-04-04 17:55:17,986 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/d5c9d23ad69a4ed0ac57a11830c170b2, entries=4, sequenceid=13, filesize=5.4 K 2023-04-04 17:55:17,986 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/477a5431b54740359dd0d1198f4030d8, entries=4, sequenceid=13, filesize=5.4 K 2023-04-04 17:55:17,987 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/0335ad488f3c462fbdfb3f62678e668b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0335ad488f3c462fbdfb3f62678e668b 2023-04-04 17:55:17,987 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/5636a2fbc29f4b1fb8cfd24ae8242506 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5636a2fbc29f4b1fb8cfd24ae8242506 2023-04-04 17:55:17,991 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0335ad488f3c462fbdfb3f62678e668b, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:55:17,991 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5636a2fbc29f4b1fb8cfd24ae8242506, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:55:17,992 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ded5805e4cf2c574f015d9078347dd47 in 1679ms, sequenceid=13, compaction requested=true 2023-04-04 17:55:17,992 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 935b30f108e870c49ac470cb0ed88be7 in 1680ms, sequenceid=13, compaction requested=true 2023-04-04 17:55:17,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:17,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:17,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:17,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:17,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:17,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:17,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:17,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-04 17:55:17,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-04 17:55:17,994 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,994 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:17,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:17,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:17,994 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:17,994 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:17,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:17,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:17,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:17,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:17,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-04 17:55:17,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b7d98cc[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:17,995 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-04 17:55:17,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:17,996 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:17,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:17,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:17,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-04 17:55:17,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-04 17:55:17,996 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:17,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,996 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:17,997 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-04 17:55:17,997 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:17,997 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-04 17:55:17,997 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:17,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:17,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:17,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:17,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:17,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:17,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:17,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:17,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:18,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-04 17:55:18,000 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-04 17:55:18,000 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:18,000 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:18,000 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-04 17:55:18,000 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:18,001 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,001 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,001 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:18,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:18,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:18,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:18,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:18,001 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:18,002 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:18,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:18,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:18,004 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:18,004 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-04 17:55:18,004 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:18,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-04 17:55:18,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:18,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:18,005 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:18,004 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,005 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:18,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:18,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:18,105 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:18,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:18,109 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:18,110 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:18,110 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:18,117 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:18,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:18,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-04 17:55:18,120 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-04 17:55:18,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:18,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-04 17:55:18,120 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-04 17:55:18,121 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,121 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:18,122 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,122 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:18,122 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:18,122 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:18,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:18,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:18,124 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-04 17:55:18,125 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-04 17:55:18,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-04 17:55:18,125 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-04 17:55:18,125 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:18,125 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-04 17:55:18,125 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:18,125 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. started... 2023-04-04 17:55:18,125 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:18,125 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:18,126 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 935b30f108e870c49ac470cb0ed88be7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:55:18,125 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:18,126 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. started... 2023-04-04 17:55:18,126 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. started... 2023-04-04 17:55:18,126 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ded5805e4cf2c574f015d9078347dd47 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:55:18,125 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:18,126 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0db0bdf042cc13ea77afe716fe561004 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:55:18,142 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:55:18,142 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x118ac2fc to 127.0.0.1:61441 2023-04-04 17:55:18,142 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:55:18,142 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:55:18,142 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63637869 to 127.0.0.1:61441 2023-04-04 17:55:18,142 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:55:18,147 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040436f8929dcada4fc2b0a91d7e048fec69 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023040436f8929dcada4fc2b0a91d7e048fec69 2023-04-04 17:55:18,552 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/0433d47ea5894bce90b876cbcc92d61e 2023-04-04 17:55:18,555 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040430004c9fa26047af935987fbe4b64dc5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023040430004c9fa26047af935987fbe4b64dc5 2023-04-04 17:55:18,556 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304043e64f83904fc4e1c801305f59411a5b7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304043e64f83904fc4e1c801305f59411a5b7 2023-04-04 17:55:18,962 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/28a6bea3ff7c458f927a0383bef30744 2023-04-04 17:55:18,962 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/bb651aad55144eb3b25ff2ca1105d0c9 2023-04-04 17:55:18,972 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404f0ee6f1c21cf44e69f0a8bfbee9eb0b9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230404f0ee6f1c21cf44e69f0a8bfbee9eb0b9 2023-04-04 17:55:19,381 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/5b16904b5e414357a1f937d765c0cac4 2023-04-04 17:55:19,389 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404fe189654b1d44370993c356350a5d24c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230404fe189654b1d44370993c356350a5d24c 2023-04-04 17:55:19,389 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404f22af2cddab44e20a4eed5cc3076a446 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230404f22af2cddab44e20a4eed5cc3076a446 2023-04-04 17:55:19,390 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/0433d47ea5894bce90b876cbcc92d61e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/0433d47ea5894bce90b876cbcc92d61e 2023-04-04 17:55:19,395 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/0433d47ea5894bce90b876cbcc92d61e, entries=4, sequenceid=17, filesize=5.4 K 2023-04-04 17:55:19,396 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/5b16904b5e414357a1f937d765c0cac4 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5b16904b5e414357a1f937d765c0cac4 2023-04-04 17:55:19,400 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5b16904b5e414357a1f937d765c0cac4, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:55:19,400 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 935b30f108e870c49ac470cb0ed88be7 in 1275ms, sequenceid=17, compaction requested=true 2023-04-04 17:55:19,400 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:19,400 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:19,400 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:19,796 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/32aa77c1a33548359e0c296fd5b1a4e5 2023-04-04 17:55:19,797 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/45c627e2d835499d96dc142192110c36 2023-04-04 17:55:19,807 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/bb651aad55144eb3b25ff2ca1105d0c9 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/bb651aad55144eb3b25ff2ca1105d0c9 2023-04-04 17:55:19,808 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/28a6bea3ff7c458f927a0383bef30744 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/28a6bea3ff7c458f927a0383bef30744 2023-04-04 17:55:19,811 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/bb651aad55144eb3b25ff2ca1105d0c9, entries=4, sequenceid=17, filesize=5.4 K 2023-04-04 17:55:19,811 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/28a6bea3ff7c458f927a0383bef30744, entries=4, sequenceid=17, filesize=5.4 K 2023-04-04 17:55:19,812 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/32aa77c1a33548359e0c296fd5b1a4e5 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/32aa77c1a33548359e0c296fd5b1a4e5 2023-04-04 17:55:19,812 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/45c627e2d835499d96dc142192110c36 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/45c627e2d835499d96dc142192110c36 2023-04-04 17:55:19,815 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/32aa77c1a33548359e0c296fd5b1a4e5, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:55:19,816 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/45c627e2d835499d96dc142192110c36, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:55:19,816 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0db0bdf042cc13ea77afe716fe561004 in 1690ms, sequenceid=17, compaction requested=true 2023-04-04 17:55:19,816 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ded5805e4cf2c574f015d9078347dd47 in 1690ms, sequenceid=17, compaction requested=true 2023-04-04 17:55:19,816 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:19,816 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:19,816 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:19,816 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:19,816 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:19,816 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:19,816 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:19,816 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,817 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-04 17:55:19,817 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-04 17:55:19,818 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,818 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:19,818 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:19,818 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:19,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:19,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:19,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:19,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-04 17:55:19,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9284b[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:19,820 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-04 17:55:19,820 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,820 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,821 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-04 17:55:19,821 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-04 17:55:19,821 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,821 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:19,821 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:19,822 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-04 17:55:19,822 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:19,822 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-04 17:55:19,822 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:19,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:19,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:19,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:19,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:19,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:19,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:19,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:19,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-04 17:55:19,825 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-04 17:55:19,825 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:19,825 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:19,825 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-04 17:55:19,825 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:19,826 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,826 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:19,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:19,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,826 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:19,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,827 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:19,828 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:19,830 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,830 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:19,830 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:19,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:19,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-04 17:55:19,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:19,830 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:19,830 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:19,830 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:19,831 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,831 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:19,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:19,831 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:19,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-04 17:55:19,831 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,831 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:19,831 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,931 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:19,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:19,947 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:19,953 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:19,961 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:19,962 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:19,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:19,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:19,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-04 17:55:19,989 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-04 17:55:19,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:19,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-04 17:55:19,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-04 17:55:19,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,989 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:19,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,990 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:19,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:19,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:19,990 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:19,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:19,991 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-04 17:55:19,991 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-04 17:55:19,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-04 17:55:19,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-04 17:55:19,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:19,991 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-04 17:55:19,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:19,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. started... 2023-04-04 17:55:19,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:19,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. started... 2023-04-04 17:55:19,992 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 935b30f108e870c49ac470cb0ed88be7 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:55:19,992 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ded5805e4cf2c574f015d9078347dd47 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:55:19,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:19,992 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:19,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:19,992 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. started... 2023-04-04 17:55:19,992 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0db0bdf042cc13ea77afe716fe561004 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:55:20,408 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/57aa3191b2294e02978ab8f871a63daa 2023-04-04 17:55:20,413 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/1a3809a0002b4a38a47555a0c5b8ed27 2023-04-04 17:55:20,413 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/581384e2e01d4cc3994a5265706115a7 2023-04-04 17:55:20,421 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57aa3191b2294e02978ab8f871a63daa 2023-04-04 17:55:20,423 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a3809a0002b4a38a47555a0c5b8ed27 2023-04-04 17:55:20,423 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 581384e2e01d4cc3994a5265706115a7 2023-04-04 17:55:20,434 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/6a15f349139b49da8476655a935bce50 2023-04-04 17:55:20,437 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a15f349139b49da8476655a935bce50 2023-04-04 17:55:20,438 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/581384e2e01d4cc3994a5265706115a7 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/581384e2e01d4cc3994a5265706115a7 2023-04-04 17:55:20,442 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 581384e2e01d4cc3994a5265706115a7 2023-04-04 17:55:20,442 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/581384e2e01d4cc3994a5265706115a7, entries=3, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:20,443 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/6a15f349139b49da8476655a935bce50 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/6a15f349139b49da8476655a935bce50 2023-04-04 17:55:20,447 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a15f349139b49da8476655a935bce50 2023-04-04 17:55:20,447 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/6a15f349139b49da8476655a935bce50, entries=1, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:20,448 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 935b30f108e870c49ac470cb0ed88be7 in 456ms, sequenceid=23, compaction requested=true 2023-04-04 17:55:20,448 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:20,448 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:20,448 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:21,241 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/c4f53d84dbbe4f51a00724ec3e25061b 2023-04-04 17:55:21,241 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/12360799306a456b88236b1cecffd0ec 2023-04-04 17:55:21,246 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4f53d84dbbe4f51a00724ec3e25061b 2023-04-04 17:55:21,247 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12360799306a456b88236b1cecffd0ec 2023-04-04 17:55:21,247 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/1a3809a0002b4a38a47555a0c5b8ed27 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/1a3809a0002b4a38a47555a0c5b8ed27 2023-04-04 17:55:21,247 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/57aa3191b2294e02978ab8f871a63daa as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/57aa3191b2294e02978ab8f871a63daa 2023-04-04 17:55:21,251 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a3809a0002b4a38a47555a0c5b8ed27 2023-04-04 17:55:21,251 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57aa3191b2294e02978ab8f871a63daa 2023-04-04 17:55:21,251 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/1a3809a0002b4a38a47555a0c5b8ed27, entries=3, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:21,251 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/57aa3191b2294e02978ab8f871a63daa, entries=3, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:21,252 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/12360799306a456b88236b1cecffd0ec as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/12360799306a456b88236b1cecffd0ec 2023-04-04 17:55:21,252 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/c4f53d84dbbe4f51a00724ec3e25061b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c4f53d84dbbe4f51a00724ec3e25061b 2023-04-04 17:55:21,255 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12360799306a456b88236b1cecffd0ec 2023-04-04 17:55:21,255 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4f53d84dbbe4f51a00724ec3e25061b 2023-04-04 17:55:21,255 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/12360799306a456b88236b1cecffd0ec, entries=1, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:21,255 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c4f53d84dbbe4f51a00724ec3e25061b, entries=1, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:21,256 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ded5805e4cf2c574f015d9078347dd47 in 1264ms, sequenceid=23, compaction requested=true 2023-04-04 17:55:21,256 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0db0bdf042cc13ea77afe716fe561004 in 1264ms, sequenceid=23, compaction requested=true 2023-04-04 17:55:21,256 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:21,256 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:21,256 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:21,256 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:21,256 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:21,256 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:21,256 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:21,256 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,256 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-04 17:55:21,256 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-04 17:55:21,257 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,257 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:21,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:21,257 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,257 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:21,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:21,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-04 17:55:21,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ada2c29[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:21,259 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-04 17:55:21,259 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-04 17:55:21,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-04 17:55:21,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:21,260 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,260 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:21,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-04 17:55:21,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:21,260 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,260 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-04 17:55:21,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:21,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-04 17:55:21,262 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-04 17:55:21,262 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:21,262 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:21,262 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-04 17:55:21,262 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:21,263 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:21,263 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:21,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:21,263 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:21,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:21,264 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-04 17:55:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:21,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:21,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-04 17:55:21,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:21,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:21,265 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:21,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-04 17:55:21,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:21,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:21,266 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,266 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:21,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-04 17:55:21,266 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-04 17:55:21,266 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:21,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:21,266 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:21,266 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-04 17:55:21,366 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:21,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:21,368 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:21,368 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 935b30f108e870c49ac470cb0ed88be7/family1 is initiating major compaction (all files) 2023-04-04 17:55:21,368 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:21,368 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:21,369 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 935b30f108e870c49ac470cb0ed88be7/family1 in ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:21,369 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/2f39c09aa8d54b1ca5b19b2e42f71453, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/b7677ca1e1ec4485bd025aec4adbeeb4, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/477a5431b54740359dd0d1198f4030d8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/0433d47ea5894bce90b876cbcc92d61e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/581384e2e01d4cc3994a5265706115a7] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp, totalSize=26.6 K 2023-04-04 17:55:21,370 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 2f39c09aa8d54b1ca5b19b2e42f71453, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630912653 2023-04-04 17:55:21,370 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting b7677ca1e1ec4485bd025aec4adbeeb4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630914475 2023-04-04 17:55:21,371 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 477a5431b54740359dd0d1198f4030d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630916299 2023-04-04 17:55:21,371 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 0433d47ea5894bce90b876cbcc92d61e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630918110 2023-04-04 17:55:21,372 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 581384e2e01d4cc3994a5265706115a7, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:21,386 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 935b30f108e870c49ac470cb0ed88be7#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:21,802 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202304049c2e826e032b4517b2478ca1d27e157c_del 2023-04-04 17:55:21,803 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304049c2e826e032b4517b2478ca1d27e157c_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304049c2e826e032b4517b2478ca1d27e157c_del 2023-04-04 17:55:22,623 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98247cfe30174b54b1095d6ee137f074 2023-04-04 17:55:22,625 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family1/98247cfe30174b54b1095d6ee137f074 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/98247cfe30174b54b1095d6ee137f074 2023-04-04 17:55:22,632 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98247cfe30174b54b1095d6ee137f074 2023-04-04 17:55:22,634 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 935b30f108e870c49ac470cb0ed88be7/family1 of 935b30f108e870c49ac470cb0ed88be7 into 98247cfe30174b54b1095d6ee137f074(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:22,634 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:22,634 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:22,634 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 935b30f108e870c49ac470cb0ed88be7/family2 is initiating major compaction (all files) 2023-04-04 17:55:22,634 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:22,634 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:22,635 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 935b30f108e870c49ac470cb0ed88be7/family2 in ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:55:22,635 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/a8fd7613e36747f0a1349643851f8b28, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/9bfada831c5e4abca533553608d7f129, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5636a2fbc29f4b1fb8cfd24ae8242506, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5b16904b5e414357a1f937d765c0cac4, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/6a15f349139b49da8476655a935bce50] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp, totalSize=25.3 K 2023-04-04 17:55:22,636 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting a8fd7613e36747f0a1349643851f8b28, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630912653 2023-04-04 17:55:22,636 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 9bfada831c5e4abca533553608d7f129, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630914475 2023-04-04 17:55:22,637 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 5636a2fbc29f4b1fb8cfd24ae8242506, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630916299 2023-04-04 17:55:22,638 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 5b16904b5e414357a1f937d765c0cac4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630918110 2023-04-04 17:55:22,639 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 6a15f349139b49da8476655a935bce50, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:22,651 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 935b30f108e870c49ac470cb0ed88be7#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:22,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/2f39c09aa8d54b1ca5b19b2e42f71453, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/b7677ca1e1ec4485bd025aec4adbeeb4, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/477a5431b54740359dd0d1198f4030d8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/0433d47ea5894bce90b876cbcc92d61e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/581384e2e01d4cc3994a5265706115a7] to archive 2023-04-04 17:55:22,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:22,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/2f39c09aa8d54b1ca5b19b2e42f71453 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/2f39c09aa8d54b1ca5b19b2e42f71453 2023-04-04 17:55:22,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/b7677ca1e1ec4485bd025aec4adbeeb4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/b7677ca1e1ec4485bd025aec4adbeeb4 2023-04-04 17:55:22,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/477a5431b54740359dd0d1198f4030d8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/477a5431b54740359dd0d1198f4030d8 2023-04-04 17:55:22,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/0433d47ea5894bce90b876cbcc92d61e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/0433d47ea5894bce90b876cbcc92d61e 2023-04-04 17:55:22,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/581384e2e01d4cc3994a5265706115a7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/581384e2e01d4cc3994a5265706115a7 2023-04-04 17:55:23,068 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202304045747de31b4684fd2aed882796edd78db_del 2023-04-04 17:55:23,068 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304045747de31b4684fd2aed882796edd78db_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202304045747de31b4684fd2aed882796edd78db_del 2023-04-04 17:55:23,895 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e30adb918e94cc58508db215b147a13 2023-04-04 17:55:23,896 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/.tmp/family2/2e30adb918e94cc58508db215b147a13 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/2e30adb918e94cc58508db215b147a13 2023-04-04 17:55:23,901 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e30adb918e94cc58508db215b147a13 2023-04-04 17:55:23,902 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 935b30f108e870c49ac470cb0ed88be7/family2 of 935b30f108e870c49ac470cb0ed88be7 into 2e30adb918e94cc58508db215b147a13(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:23,903 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:23,903 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:23,903 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): ded5805e4cf2c574f015d9078347dd47/family1 is initiating major compaction (all files) 2023-04-04 17:55:23,903 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:23,903 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:23,903 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of ded5805e4cf2c574f015d9078347dd47/family1 in ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:23,903 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/00474f2b35df4a399701c6204305b62b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/c8057a897bc54d90b9453d8a04facead, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/d5c9d23ad69a4ed0ac57a11830c170b2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/28a6bea3ff7c458f927a0383bef30744, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/57aa3191b2294e02978ab8f871a63daa] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp, totalSize=26.6 K 2023-04-04 17:55:23,904 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 00474f2b35df4a399701c6204305b62b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630912652 2023-04-04 17:55:23,905 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting c8057a897bc54d90b9453d8a04facead, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630914474 2023-04-04 17:55:23,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/a8fd7613e36747f0a1349643851f8b28, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/9bfada831c5e4abca533553608d7f129, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5636a2fbc29f4b1fb8cfd24ae8242506, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5b16904b5e414357a1f937d765c0cac4, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/6a15f349139b49da8476655a935bce50] to archive 2023-04-04 17:55:23,905 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting d5c9d23ad69a4ed0ac57a11830c170b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630916299 2023-04-04 17:55:23,906 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 28a6bea3ff7c458f927a0383bef30744, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630918109 2023-04-04 17:55:23,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:23,907 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 57aa3191b2294e02978ab8f871a63daa, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:23,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/a8fd7613e36747f0a1349643851f8b28 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/a8fd7613e36747f0a1349643851f8b28 2023-04-04 17:55:23,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/9bfada831c5e4abca533553608d7f129 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/9bfada831c5e4abca533553608d7f129 2023-04-04 17:55:23,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5636a2fbc29f4b1fb8cfd24ae8242506 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5636a2fbc29f4b1fb8cfd24ae8242506 2023-04-04 17:55:23,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5b16904b5e414357a1f937d765c0cac4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/5b16904b5e414357a1f937d765c0cac4 2023-04-04 17:55:23,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/6a15f349139b49da8476655a935bce50 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family2/6a15f349139b49da8476655a935bce50 2023-04-04 17:55:23,918 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): ded5805e4cf2c574f015d9078347dd47#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:24,334 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230404878ec4d7e0a948c1b4bddb35fbe01dcd_del 2023-04-04 17:55:24,335 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404878ec4d7e0a948c1b4bddb35fbe01dcd_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230404878ec4d7e0a948c1b4bddb35fbe01dcd_del 2023-04-04 17:55:25,166 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e890f144b7ba481c9ff2f013f0485089 2023-04-04 17:55:25,167 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family1/e890f144b7ba481c9ff2f013f0485089 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/e890f144b7ba481c9ff2f013f0485089 2023-04-04 17:55:25,172 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e890f144b7ba481c9ff2f013f0485089 2023-04-04 17:55:25,173 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ded5805e4cf2c574f015d9078347dd47/family1 of ded5805e4cf2c574f015d9078347dd47 into e890f144b7ba481c9ff2f013f0485089(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:25,173 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:25,173 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:25,174 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): ded5805e4cf2c574f015d9078347dd47/family2 is initiating major compaction (all files) 2023-04-04 17:55:25,174 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:25,174 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:25,174 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of ded5805e4cf2c574f015d9078347dd47/family2 in ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:55:25,174 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0958637a10104d5eb98fe9498a9fecd7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/303aaa4cbfbb4977b71e31fa8d5f9f50, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0335ad488f3c462fbdfb3f62678e668b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/45c627e2d835499d96dc142192110c36, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/12360799306a456b88236b1cecffd0ec] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp, totalSize=25.3 K 2023-04-04 17:55:25,175 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 0958637a10104d5eb98fe9498a9fecd7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630912652 2023-04-04 17:55:25,175 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 303aaa4cbfbb4977b71e31fa8d5f9f50, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630914474 2023-04-04 17:55:25,176 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 0335ad488f3c462fbdfb3f62678e668b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630916299 2023-04-04 17:55:25,176 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 45c627e2d835499d96dc142192110c36, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630918109 2023-04-04 17:55:25,176 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 12360799306a456b88236b1cecffd0ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:25,189 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): ded5805e4cf2c574f015d9078347dd47#family2#compaction#153 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:25,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/00474f2b35df4a399701c6204305b62b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/c8057a897bc54d90b9453d8a04facead, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/d5c9d23ad69a4ed0ac57a11830c170b2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/28a6bea3ff7c458f927a0383bef30744, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/57aa3191b2294e02978ab8f871a63daa] to archive 2023-04-04 17:55:25,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:25,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/00474f2b35df4a399701c6204305b62b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/00474f2b35df4a399701c6204305b62b 2023-04-04 17:55:25,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/c8057a897bc54d90b9453d8a04facead to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/c8057a897bc54d90b9453d8a04facead 2023-04-04 17:55:25,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/d5c9d23ad69a4ed0ac57a11830c170b2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/d5c9d23ad69a4ed0ac57a11830c170b2 2023-04-04 17:55:25,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/28a6bea3ff7c458f927a0383bef30744 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/28a6bea3ff7c458f927a0383bef30744 2023-04-04 17:55:25,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/57aa3191b2294e02978ab8f871a63daa to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/57aa3191b2294e02978ab8f871a63daa 2023-04-04 17:55:25,607 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023040468676c9060484261aa024f68145c62b0_del 2023-04-04 17:55:25,607 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040468676c9060484261aa024f68145c62b0_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023040468676c9060484261aa024f68145c62b0_del 2023-04-04 17:55:26,437 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86d5d6519f4d465b8f6f030d9c81f9d4 2023-04-04 17:55:26,438 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/.tmp/family2/86d5d6519f4d465b8f6f030d9c81f9d4 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/86d5d6519f4d465b8f6f030d9c81f9d4 2023-04-04 17:55:26,443 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86d5d6519f4d465b8f6f030d9c81f9d4 2023-04-04 17:55:26,444 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ded5805e4cf2c574f015d9078347dd47/family2 of ded5805e4cf2c574f015d9078347dd47 into 86d5d6519f4d465b8f6f030d9c81f9d4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:26,444 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:26,444 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:26,444 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 0db0bdf042cc13ea77afe716fe561004/family1 is initiating major compaction (all files) 2023-04-04 17:55:26,444 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:26,444 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:26,444 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 0db0bdf042cc13ea77afe716fe561004/family1 in ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:26,444 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/81f5121727284fee961cbab4eea96966, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/ba422a5ce0e74836a37374f2f0127ac3, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/c2b2024cf74046a8bd7e7961941bbb8f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/bb651aad55144eb3b25ff2ca1105d0c9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/1a3809a0002b4a38a47555a0c5b8ed27] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp, totalSize=26.6 K 2023-04-04 17:55:26,445 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 81f5121727284fee961cbab4eea96966, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630912653 2023-04-04 17:55:26,445 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting ba422a5ce0e74836a37374f2f0127ac3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630914475 2023-04-04 17:55:26,446 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting c2b2024cf74046a8bd7e7961941bbb8f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630916299 2023-04-04 17:55:26,447 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting bb651aad55144eb3b25ff2ca1105d0c9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630918110 2023-04-04 17:55:26,447 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 1a3809a0002b4a38a47555a0c5b8ed27, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:26,459 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 0db0bdf042cc13ea77afe716fe561004#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:26,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0958637a10104d5eb98fe9498a9fecd7, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/303aaa4cbfbb4977b71e31fa8d5f9f50, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0335ad488f3c462fbdfb3f62678e668b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/45c627e2d835499d96dc142192110c36, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/12360799306a456b88236b1cecffd0ec] to archive 2023-04-04 17:55:26,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:26,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0958637a10104d5eb98fe9498a9fecd7 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0958637a10104d5eb98fe9498a9fecd7 2023-04-04 17:55:26,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/303aaa4cbfbb4977b71e31fa8d5f9f50 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/303aaa4cbfbb4977b71e31fa8d5f9f50 2023-04-04 17:55:26,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0335ad488f3c462fbdfb3f62678e668b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/0335ad488f3c462fbdfb3f62678e668b 2023-04-04 17:55:26,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/45c627e2d835499d96dc142192110c36 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/45c627e2d835499d96dc142192110c36 2023-04-04 17:55:26,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/12360799306a456b88236b1cecffd0ec to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family2/12360799306a456b88236b1cecffd0ec 2023-04-04 17:55:26,878 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230404ffa11a97bb8d4726aa5788cb7795f032_del 2023-04-04 17:55:26,878 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404ffa11a97bb8d4726aa5788cb7795f032_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230404ffa11a97bb8d4726aa5788cb7795f032_del 2023-04-04 17:55:27,301 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 941bbcc1bba249cda345734ab6176454 2023-04-04 17:55:27,302 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family1/941bbcc1bba249cda345734ab6176454 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/941bbcc1bba249cda345734ab6176454 2023-04-04 17:55:27,308 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 941bbcc1bba249cda345734ab6176454 2023-04-04 17:55:27,309 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0db0bdf042cc13ea77afe716fe561004/family1 of 0db0bdf042cc13ea77afe716fe561004 into 941bbcc1bba249cda345734ab6176454(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:27,310 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:27,310 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:27,310 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 0db0bdf042cc13ea77afe716fe561004/family2 is initiating major compaction (all files) 2023-04-04 17:55:27,310 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:27,310 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:27,310 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 0db0bdf042cc13ea77afe716fe561004/family2 in ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:55:27,310 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/3bc061260bfb40e8a9b6f0545833f22b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/8221bdf183464d48babe07167854a7ab, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c6012d20f16740248bbb55dab9256650, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/32aa77c1a33548359e0c296fd5b1a4e5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c4f53d84dbbe4f51a00724ec3e25061b] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp, totalSize=25.3 K 2023-04-04 17:55:27,311 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 3bc061260bfb40e8a9b6f0545833f22b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630912653 2023-04-04 17:55:27,311 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 8221bdf183464d48babe07167854a7ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630914475 2023-04-04 17:55:27,312 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting c6012d20f16740248bbb55dab9256650, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630916299 2023-04-04 17:55:27,312 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 32aa77c1a33548359e0c296fd5b1a4e5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630918110 2023-04-04 17:55:27,312 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting c4f53d84dbbe4f51a00724ec3e25061b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:27,319 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 0db0bdf042cc13ea77afe716fe561004#family2#compaction#155 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:27,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/81f5121727284fee961cbab4eea96966, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/ba422a5ce0e74836a37374f2f0127ac3, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/c2b2024cf74046a8bd7e7961941bbb8f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/bb651aad55144eb3b25ff2ca1105d0c9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/1a3809a0002b4a38a47555a0c5b8ed27] to archive 2023-04-04 17:55:27,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:27,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/81f5121727284fee961cbab4eea96966 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/81f5121727284fee961cbab4eea96966 2023-04-04 17:55:27,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/ba422a5ce0e74836a37374f2f0127ac3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/ba422a5ce0e74836a37374f2f0127ac3 2023-04-04 17:55:27,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/c2b2024cf74046a8bd7e7961941bbb8f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/c2b2024cf74046a8bd7e7961941bbb8f 2023-04-04 17:55:27,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/bb651aad55144eb3b25ff2ca1105d0c9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/bb651aad55144eb3b25ff2ca1105d0c9 2023-04-04 17:55:27,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/1a3809a0002b4a38a47555a0c5b8ed27 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/1a3809a0002b4a38a47555a0c5b8ed27 2023-04-04 17:55:27,728 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230404a67898d8d09541ed8c995726fca1cada_del 2023-04-04 17:55:27,728 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404a67898d8d09541ed8c995726fca1cada_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230404a67898d8d09541ed8c995726fca1cada_del 2023-04-04 17:55:28,563 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32fb07dd76ba4808b2a57e5b380731b8 2023-04-04 17:55:28,565 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/.tmp/family2/32fb07dd76ba4808b2a57e5b380731b8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/32fb07dd76ba4808b2a57e5b380731b8 2023-04-04 17:55:28,568 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32fb07dd76ba4808b2a57e5b380731b8 2023-04-04 17:55:28,569 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0db0bdf042cc13ea77afe716fe561004/family2 of 0db0bdf042cc13ea77afe716fe561004 into 32fb07dd76ba4808b2a57e5b380731b8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:28,569 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:28,573 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:28,575 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:28,580 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:28,582 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:28,589 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-04 17:55:28,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/3bc061260bfb40e8a9b6f0545833f22b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/8221bdf183464d48babe07167854a7ab, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c6012d20f16740248bbb55dab9256650, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/32aa77c1a33548359e0c296fd5b1a4e5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c4f53d84dbbe4f51a00724ec3e25061b] to archive 2023-04-04 17:55:28,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:28,608 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-04-04 17:55:28,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/3bc061260bfb40e8a9b6f0545833f22b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/3bc061260bfb40e8a9b6f0545833f22b 2023-04-04 17:55:28,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/8221bdf183464d48babe07167854a7ab to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/8221bdf183464d48babe07167854a7ab 2023-04-04 17:55:28,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c6012d20f16740248bbb55dab9256650 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c6012d20f16740248bbb55dab9256650 2023-04-04 17:55:28,611 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230404878ec4d7e0a948c1b4bddb35fbe01dcd_del 2023-04-04 17:55:28,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/32aa77c1a33548359e0c296fd5b1a4e5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/32aa77c1a33548359e0c296fd5b1a4e5 2023-04-04 17:55:28,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c4f53d84dbbe4f51a00724ec3e25061b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family2/c4f53d84dbbe4f51a00724ec3e25061b 2023-04-04 17:55:28,614 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202304049c2e826e032b4517b2478ca1d27e157c_del 2023-04-04 17:55:28,616 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230404ffa11a97bb8d4726aa5788cb7795f032_del 2023-04-04 17:55:28,616 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:28,617 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(139): Connect 0x7ae2c1dd to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:55:28,620 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@470c2a3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:55:28,621 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230404 for table='ns:testMinorCompaction' and column='family1' 2023-04-04 17:55:28,621 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230404 for table='ns:testMinorCompaction' and column='family1' 2023-04-04 17:55:28,621 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230404 for table='ns:testMinorCompaction' and column='family1' 2023-04-04 17:55:29,048 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404861698ea98534dc6ba290386f6b92022 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230404861698ea98534dc6ba290386f6b92022 2023-04-04 17:55:29,049 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:29,060 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:55:29,062 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:55:29,068 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:55:29,071 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:55:29,082 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/family1/ab459de676fb46768bcdb9ef43518e02 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-04-04 17:55:29,082 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/family1/ab459de676fb46768bcdb9ef43518e02}] 2023-04-04 17:55:29,088 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/family1/ab459de676fb46768bcdb9ef43518e02 for inclusion in ded5805e4cf2c574f015d9078347dd47/family1 2023-04-04 17:55:29,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-04-04 17:55:29,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last=1 2023-04-04 17:55:29,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:55:29,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230404/family1/ab459de676fb46768bcdb9ef43518e02 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__ir5juak42t0f4uagggsua25k36jmsevkpbm7m1ln3v1cbsd1pu8080rs50vkftf6/family1/ab459de676fb46768bcdb9ef43518e02 2023-04-04 17:55:29,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__ir5juak42t0f4uagggsua25k36jmsevkpbm7m1ln3v1cbsd1pu8080rs50vkftf6/family1/ab459de676fb46768bcdb9ef43518e02 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/db9937129995405ca7fe968437f7c97d_SeqId_28_ 2023-04-04 17:55:29,092 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__ir5juak42t0f4uagggsua25k36jmsevkpbm7m1ln3v1cbsd1pu8080rs50vkftf6/family1/ab459de676fb46768bcdb9ef43518e02 into ded5805e4cf2c574f015d9078347dd47/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/db9937129995405ca7fe968437f7c97d_SeqId_28_ - updating store file list. 2023-04-04 17:55:29,095 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/db9937129995405ca7fe968437f7c97d_SeqId_28_ into ded5805e4cf2c574f015d9078347dd47/family1 2023-04-04 17:55:29,095 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__ir5juak42t0f4uagggsua25k36jmsevkpbm7m1ln3v1cbsd1pu8080rs50vkftf6/family1/ab459de676fb46768bcdb9ef43518e02 into ded5805e4cf2c574f015d9078347dd47/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/family1/db9937129995405ca7fe968437f7c97d_SeqId_28_) 2023-04-04 17:55:29,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__ir5juak42t0f4uagggsua25k36jmsevkpbm7m1ln3v1cbsd1pu8080rs50vkftf6/family1/ab459de676fb46768bcdb9ef43518e02 2023-04-04 17:55:29,097 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:29,097 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:29,098 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230404f8c9009840da44bfb93e6ad58cd11e35 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230404f8c9009840da44bfb93e6ad58cd11e35 2023-04-04 17:55:29,098 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-04-04 17:55:29,098 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230404' 2023-04-04 17:55:29,099 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230404 for table='ns:testMinorCompaction' and column='family1' 2023-04-04 17:55:29,448 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304045a76e20a3d2445b39633154d583d8802 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304045a76e20a3d2445b39633154d583d8802 2023-04-04 17:55:29,449 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:29,452 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304049325a7b81b0a46259cae947eb3f25ba8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304049325a7b81b0a46259cae947eb3f25ba8 2023-04-04 17:55:29,453 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:29,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230404/family1/1b7aaed6d59e46c4b830ea1940d05e62 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-04-04 17:55:29,473 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230404/family1/1b7aaed6d59e46c4b830ea1940d05e62}] 2023-04-04 17:55:29,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ae04dae47d5045b7b326e0f28f7cc776 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-04-04 17:55:29,474 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ae04dae47d5045b7b326e0f28f7cc776}] 2023-04-04 17:55:29,476 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230404/family1/1b7aaed6d59e46c4b830ea1940d05e62 for inclusion in 935b30f108e870c49ac470cb0ed88be7/family1 2023-04-04 17:55:29,476 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ae04dae47d5045b7b326e0f28f7cc776 for inclusion in 0db0bdf042cc13ea77afe716fe561004/family1 2023-04-04 17:55:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-04-04 17:55:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-04-04 17:55:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-04 17:55:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-04 17:55:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:55:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:55:29,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230404/family1/ae04dae47d5045b7b326e0f28f7cc776 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__bi5qeo2n2j2gpd5qaa9f67slm0csngfch6dmrslupqfoh9kd8aph0ijocprkgu1o/family1/ae04dae47d5045b7b326e0f28f7cc776 2023-04-04 17:55:29,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230404/family1/1b7aaed6d59e46c4b830ea1940d05e62 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__a8e39btus0b2dimvum46ieqsa524u3tvdee4jo3tv4f7vqa5h9v1sk8jd64f5puf/family1/1b7aaed6d59e46c4b830ea1940d05e62 2023-04-04 17:55:29,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__bi5qeo2n2j2gpd5qaa9f67slm0csngfch6dmrslupqfoh9kd8aph0ijocprkgu1o/family1/ae04dae47d5045b7b326e0f28f7cc776 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/f71171df34c248f6a81d7c083010df5d_SeqId_28_ 2023-04-04 17:55:29,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__a8e39btus0b2dimvum46ieqsa524u3tvdee4jo3tv4f7vqa5h9v1sk8jd64f5puf/family1/1b7aaed6d59e46c4b830ea1940d05e62 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/e0fa386532ac467da6a7593d245d8368_SeqId_28_ 2023-04-04 17:55:29,481 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__bi5qeo2n2j2gpd5qaa9f67slm0csngfch6dmrslupqfoh9kd8aph0ijocprkgu1o/family1/ae04dae47d5045b7b326e0f28f7cc776 into 0db0bdf042cc13ea77afe716fe561004/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/f71171df34c248f6a81d7c083010df5d_SeqId_28_ - updating store file list. 2023-04-04 17:55:29,481 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__a8e39btus0b2dimvum46ieqsa524u3tvdee4jo3tv4f7vqa5h9v1sk8jd64f5puf/family1/1b7aaed6d59e46c4b830ea1940d05e62 into 935b30f108e870c49ac470cb0ed88be7/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/e0fa386532ac467da6a7593d245d8368_SeqId_28_ - updating store file list. 2023-04-04 17:55:29,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/e0fa386532ac467da6a7593d245d8368_SeqId_28_ into 935b30f108e870c49ac470cb0ed88be7/family1 2023-04-04 17:55:29,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__a8e39btus0b2dimvum46ieqsa524u3tvdee4jo3tv4f7vqa5h9v1sk8jd64f5puf/family1/1b7aaed6d59e46c4b830ea1940d05e62 into 935b30f108e870c49ac470cb0ed88be7/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/family1/e0fa386532ac467da6a7593d245d8368_SeqId_28_) 2023-04-04 17:55:29,483 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/f71171df34c248f6a81d7c083010df5d_SeqId_28_ into 0db0bdf042cc13ea77afe716fe561004/family1 2023-04-04 17:55:29,483 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__bi5qeo2n2j2gpd5qaa9f67slm0csngfch6dmrslupqfoh9kd8aph0ijocprkgu1o/family1/ae04dae47d5045b7b326e0f28f7cc776 into 0db0bdf042cc13ea77afe716fe561004/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/family1/f71171df34c248f6a81d7c083010df5d_SeqId_28_) 2023-04-04 17:55:29,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__a8e39btus0b2dimvum46ieqsa524u3tvdee4jo3tv4f7vqa5h9v1sk8jd64f5puf/family1/1b7aaed6d59e46c4b830ea1940d05e62 2023-04-04 17:55:29,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__ns_testMinorCompaction__bi5qeo2n2j2gpd5qaa9f67slm0csngfch6dmrslupqfoh9kd8aph0ijocprkgu1o/family1/ae04dae47d5045b7b326e0f28f7cc776 2023-04-04 17:55:29,485 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:29,485 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:29,485 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:29,485 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:29,486 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304040826ece789f041f3bd4f86dfac221e73 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304040826ece789f041f3bd4f86dfac221e73 2023-04-04 17:55:29,486 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-04-04 17:55:29,486 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230404' 2023-04-04 17:55:29,486 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230404a137d6d3634c47238ceba29d1d019539 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230404a137d6d3634c47238ceba29d1d019539 2023-04-04 17:55:29,486 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-04-04 17:55:29,486 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230404' 2023-04-04 17:55:29,487 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230404 for table='ns:testMinorCompaction' and column='family1' 2023-04-04 17:55:29,487 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230404 for table='ns:testMinorCompaction' and column='family1' 2023-04-04 17:55:29,487 INFO [Listener at localhost.localdomain/45763] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-04-04 17:55:29,489 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:29,491 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:29,493 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:29,493 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:29,508 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=247 (was 284), OpenFileDescriptor=627 (was 757), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 176), ProcessCount=173 (was 175), AvailableMemoryMB=6693 (was 6701) 2023-04-04 17:55:29,517 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=173, AvailableMemoryMB=6692 2023-04-04 17:55:29,519 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-04 17:55:29,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:29,521 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:55:29,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-04-04 17:55:29,522 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:55:29,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-04 17:55:29,523 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:29,523 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e empty. 2023-04-04 17:55:29,524 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:29,524 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-04-04 17:55:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-04 17:55:29,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-04 17:55:29,933 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-04 17:55:29,936 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => a3d3fb9dbe50c3b06556b7af58c1b61e, NAME => 'testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:55:30,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-04 17:55:30,348 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:30,349 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing a3d3fb9dbe50c3b06556b7af58c1b61e, disabling compactions & flushes 2023-04-04 17:55:30,349 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:30,349 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:30,349 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. after waiting 0 ms 2023-04-04 17:55:30,349 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:30,349 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:30,349 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:30,355 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:55:30,358 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680630930358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630930358"}]},"ts":"1680630930358"} 2023-04-04 17:55:30,359 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-04 17:55:30,360 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:55:30,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630930360"}]},"ts":"1680630930360"} 2023-04-04 17:55:30,361 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-04-04 17:55:30,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a3d3fb9dbe50c3b06556b7af58c1b61e, ASSIGN}] 2023-04-04 17:55:30,365 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a3d3fb9dbe50c3b06556b7af58c1b61e, ASSIGN 2023-04-04 17:55:30,365 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a3d3fb9dbe50c3b06556b7af58c1b61e, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:55:30,517 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a3d3fb9dbe50c3b06556b7af58c1b61e, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:30,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680630930517"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630930517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630930517"}]},"ts":"1680630930517"} 2023-04-04 17:55:30,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure a3d3fb9dbe50c3b06556b7af58c1b61e, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:30,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-04 17:55:30,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:30,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3d3fb9dbe50c3b06556b7af58c1b61e, NAME => 'testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e.', STARTKEY => '', ENDKEY => ''} 2023-04-04 17:55:30,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:30,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:30,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:30,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:30,685 INFO [StoreOpener-a3d3fb9dbe50c3b06556b7af58c1b61e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:30,687 DEBUG [StoreOpener-a3d3fb9dbe50c3b06556b7af58c1b61e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:30,687 DEBUG [StoreOpener-a3d3fb9dbe50c3b06556b7af58c1b61e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:30,687 INFO [StoreOpener-a3d3fb9dbe50c3b06556b7af58c1b61e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3d3fb9dbe50c3b06556b7af58c1b61e columnFamilyName family1 2023-04-04 17:55:30,689 INFO [StoreOpener-a3d3fb9dbe50c3b06556b7af58c1b61e-1] regionserver.HStore(310): Store=a3d3fb9dbe50c3b06556b7af58c1b61e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:30,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:30,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:30,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:55:30,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:55:30,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a3d3fb9dbe50c3b06556b7af58c1b61e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66481666, jitterRate=-0.009345978498458862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-04 17:55:30,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:30,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e., pid=114, masterSystemTime=1680630930675 2023-04-04 17:55:30,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:30,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:30,699 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a3d3fb9dbe50c3b06556b7af58c1b61e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:30,699 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680630930699"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630930699"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630930699"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630930699"}]},"ts":"1680630930699"} 2023-04-04 17:55:30,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-04-04 17:55:30,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure a3d3fb9dbe50c3b06556b7af58c1b61e, server=jenkins-hbase17.apache.org,46251,1680630785259 in 180 msec 2023-04-04 17:55:30,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-04-04 17:55:30,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a3d3fb9dbe50c3b06556b7af58c1b61e, ASSIGN in 339 msec 2023-04-04 17:55:30,705 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:55:30,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630930705"}]},"ts":"1680630930705"} 2023-04-04 17:55:30,706 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-04-04 17:55:30,708 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:55:30,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1880 sec 2023-04-04 17:55:31,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-04 17:55:31,632 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-04-04 17:55:31,658 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:31,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,665 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:31,665 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:31,665 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:31,665 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:31,665 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,665 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,666 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,666 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:31,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:31,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:31,666 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,666 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:31,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,667 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,667 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:31,668 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:31,668 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:31,668 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:31,668 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:31,668 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:31,668 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:31,669 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-04 17:55:31,713 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308694c6b7d10d4eceb4ba068d6ee5a858 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511308694c6b7d10d4eceb4ba068d6ee5a858 2023-04-04 17:55:31,716 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/5bfe3333c1974a129a1694309ab3fe22 2023-04-04 17:55:31,720 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/5bfe3333c1974a129a1694309ab3fe22 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5bfe3333c1974a129a1694309ab3fe22 2023-04-04 17:55:31,723 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5bfe3333c1974a129a1694309ab3fe22, entries=1000, sequenceid=5, filesize=166.0 K 2023-04-04 17:55:31,724 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 55ms, sequenceid=5, compaction requested=false 2023-04-04 17:55:31,724 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:31,724 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:31,724 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:31,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:31,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:31,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:31,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:31,725 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,725 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:31,726 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:31,726 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:31,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:31,727 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:31,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eee449[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:31,727 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,728 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,728 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:31,728 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:31,728 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:31,728 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,728 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:31,729 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:31,729 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:31,729 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:31,729 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:31,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:31,732 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:31,732 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:31,732 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:31,732 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,732 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:31,734 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,734 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,734 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:31,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:31,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:31,735 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:31,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,739 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,741 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:31,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,742 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:31,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:31,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:31,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:31,742 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:31,743 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:31,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:31,843 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:31,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:31,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:31,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:31,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,850 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:31,850 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:31,850 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:31,850 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:31,850 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,850 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,851 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,851 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:31,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:31,851 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:31,851 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,852 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:31,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:31,852 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:31,852 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:31,852 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:31,852 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:31,852 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:31,852 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:31,852 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:31,852 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-04 17:55:32,265 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112850c15292c9c9412c972023cf532a61b6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112850c15292c9c9412c972023cf532a61b6 2023-04-04 17:55:32,669 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/bcc87dabbfa44f9ea3c7f96db5011f0e 2023-04-04 17:55:32,673 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/bcc87dabbfa44f9ea3c7f96db5011f0e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bcc87dabbfa44f9ea3c7f96db5011f0e 2023-04-04 17:55:32,676 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bcc87dabbfa44f9ea3c7f96db5011f0e, entries=1, sequenceid=9, filesize=5.0 K 2023-04-04 17:55:32,677 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 825ms, sequenceid=9, compaction requested=false 2023-04-04 17:55:32,677 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:32,677 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:32,677 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:32,677 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:32,677 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,677 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:32,677 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:32,678 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,678 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:32,678 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:32,679 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:32,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:32,680 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:32,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@316b5bed[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:32,680 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,680 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,680 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:32,680 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:32,680 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,680 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:32,680 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:32,681 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,681 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:32,681 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:32,681 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:32,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:32,683 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:32,683 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:32,683 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:32,683 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,683 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:32,683 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,683 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,683 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:32,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:32,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:32,684 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,685 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,687 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,687 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:32,687 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:32,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,687 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:32,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:32,688 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:32,788 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:32,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:32,793 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:32,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:32,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,795 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:32,795 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:32,795 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:32,795 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:32,795 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,796 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,796 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:32,796 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:32,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:32,797 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:32,797 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:32,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,798 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,799 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:32,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:32,799 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:32,799 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:32,799 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:32,799 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:32,799 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:32,799 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:32,799 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:32,799 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:33,224 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120122ac97549d2d486eb241b5a2a19090cc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120122ac97549d2d486eb241b5a2a19090cc 2023-04-04 17:55:33,633 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/b8659f1641e740c58c073721d818ff61 2023-04-04 17:55:33,644 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/b8659f1641e740c58c073721d818ff61 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/b8659f1641e740c58c073721d818ff61 2023-04-04 17:55:33,653 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/b8659f1641e740c58c073721d818ff61, entries=1, sequenceid=13, filesize=4.9 K 2023-04-04 17:55:33,655 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 856ms, sequenceid=13, compaction requested=true 2023-04-04 17:55:33,655 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:33,655 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:33,655 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:33,655 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:33,655 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,655 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:33,655 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:33,657 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,657 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:33,658 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,658 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:33,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:33,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa6c665[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:33,661 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:33,661 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,662 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,662 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:33,662 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:33,662 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:33,662 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,662 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:33,663 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:33,663 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:33,663 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,664 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:33,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:33,667 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:33,667 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:33,667 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:33,668 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,668 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:33,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,669 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,670 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:33,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:33,671 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,672 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,675 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,675 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:33,675 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,675 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:33,676 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:33,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:33,675 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:33,676 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:33,675 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:33,675 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:33,676 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:33,676 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,676 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,677 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,677 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:33,776 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:33,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:33,781 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:33,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:33,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,783 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:33,783 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:33,783 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:33,783 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:33,784 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,784 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,785 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:33,785 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:33,785 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:33,785 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,787 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:33,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:33,787 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:33,787 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:33,787 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:33,787 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:33,787 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:33,787 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:33,787 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:33,788 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:34,204 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058a48d2e19bfc488fa276d9ab1b744436 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058a48d2e19bfc488fa276d9ab1b744436 2023-04-04 17:55:34,611 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/7e2cc970da8a4a07bbbf09e2538c11e5 2023-04-04 17:55:34,614 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/7e2cc970da8a4a07bbbf09e2538c11e5 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/7e2cc970da8a4a07bbbf09e2538c11e5 2023-04-04 17:55:34,618 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/7e2cc970da8a4a07bbbf09e2538c11e5, entries=1, sequenceid=17, filesize=4.9 K 2023-04-04 17:55:34,619 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 831ms, sequenceid=17, compaction requested=true 2023-04-04 17:55:34,619 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:34,619 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:34,619 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:34,619 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:34,619 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,619 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:34,619 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:34,620 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,620 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:34,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:34,620 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,620 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:34,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:34,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:34,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:34,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:34,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@345606dc[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:34,622 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:34,622 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,622 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,622 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:34,622 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:34,623 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:34,623 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,623 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:34,623 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:34,623 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,623 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:34,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:34,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:34,623 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:34,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:34,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:34,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:34,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:34,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:34,626 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:34,626 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:34,626 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:34,626 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,626 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:34,627 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,627 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,627 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:34,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:34,628 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:34,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:34,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,629 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:34,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,630 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,630 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:34,630 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,630 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:34,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:34,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:34,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:34,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:34,630 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:34,630 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:34,631 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:34,630 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,631 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:34,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:34,631 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:34,631 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,631 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,731 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:34,741 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:34,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:34,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,744 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:34,744 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:34,744 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:34,744 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:34,745 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,746 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,747 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:34,747 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:34,748 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:34,748 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:34,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,750 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,750 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:34,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:34,751 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:34,751 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:34,751 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:35,170 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122877a36391ca5d4611a6b4dd3241cf0f6d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122877a36391ca5d4611a6b4dd3241cf0f6d 2023-04-04 17:55:35,578 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/5c6e52da878a4d168eff3beb7611cc86 2023-04-04 17:55:35,589 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/5c6e52da878a4d168eff3beb7611cc86 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5c6e52da878a4d168eff3beb7611cc86 2023-04-04 17:55:35,594 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5c6e52da878a4d168eff3beb7611cc86, entries=1, sequenceid=21, filesize=4.9 K 2023-04-04 17:55:35,595 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 844ms, sequenceid=21, compaction requested=true 2023-04-04 17:55:35,595 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:35,595 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:35,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:35,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:35,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:35,596 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:35,597 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,597 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:35,598 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,598 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:35,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:35,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46e870b3[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:35,600 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:35,600 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,601 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,601 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:35,601 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:35,601 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:35,601 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,601 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:35,602 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:35,602 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:35,602 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:35,602 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:35,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:35,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:35,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:35,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:35,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:35,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:35,606 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:35,606 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:35,606 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:35,606 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,606 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:35,608 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,609 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,609 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:35,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:35,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:35,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,609 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:35,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:35,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:35,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,611 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:35,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:35,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:35,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:35,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,614 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:35,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:35,614 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:35,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:35,615 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,615 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,615 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:35,715 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:35,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:35,720 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:35,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:35,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,721 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:35,721 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:35,721 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:35,721 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:35,722 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,722 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,722 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:35,722 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:35,723 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:35,723 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,723 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,724 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:35,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:35,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:35,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:35,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:35,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:35,724 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:35,724 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:35,724 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:35,724 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:36,142 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d53df243f1a446c8a4b795ff257da1f1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d53df243f1a446c8a4b795ff257da1f1 2023-04-04 17:55:36,221 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:55:36,549 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/9618a1a5f37547bbbfa37257b04fa991 2023-04-04 17:55:36,556 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/9618a1a5f37547bbbfa37257b04fa991 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/9618a1a5f37547bbbfa37257b04fa991 2023-04-04 17:55:36,562 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/9618a1a5f37547bbbfa37257b04fa991, entries=1, sequenceid=25, filesize=4.9 K 2023-04-04 17:55:36,563 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 839ms, sequenceid=25, compaction requested=true 2023-04-04 17:55:36,563 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:36,563 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:36,563 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:36,563 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:36,563 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,563 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:36,563 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:36,565 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,565 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:36,566 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,566 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:36,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:36,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:36,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:36,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2db7efb0[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:36,568 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:36,568 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,569 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,570 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:36,570 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:36,570 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:36,570 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,570 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:36,571 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:36,571 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:36,571 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,572 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:36,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:36,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:36,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:36,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:36,576 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:36,576 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:36,576 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:36,576 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,576 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:36,577 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,577 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:36,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,577 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:36,578 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:36,579 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,582 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,582 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:36,582 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:36,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:36,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:36,582 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:36,583 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:36,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:36,683 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:36,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:36,693 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:36,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:36,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,695 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:36,695 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:36,695 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:36,695 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:36,696 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,696 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,697 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:36,697 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:36,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:36,697 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:36,697 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:36,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:36,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,698 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:36,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:36,698 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:36,698 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:36,698 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:36,699 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:36,699 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:36,699 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:36,699 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:36,699 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:36,714 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ebff5104699b488eb1dd5af1dde36af2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101ebff5104699b488eb1dd5af1dde36af2 2023-04-04 17:55:37,122 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/bb49f5b1ba7047459954eb18b0cdbb66 2023-04-04 17:55:37,132 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/bb49f5b1ba7047459954eb18b0cdbb66 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bb49f5b1ba7047459954eb18b0cdbb66 2023-04-04 17:55:37,136 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bb49f5b1ba7047459954eb18b0cdbb66, entries=1, sequenceid=29, filesize=4.9 K 2023-04-04 17:55:37,137 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 438ms, sequenceid=29, compaction requested=true 2023-04-04 17:55:37,137 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:37,137 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:37,137 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:37,138 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:37,138 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,138 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:37,138 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:37,139 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,139 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:37,140 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,140 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:37,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:37,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:37,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:37,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64eb918d[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:37,142 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:37,142 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,143 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,144 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:37,144 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,144 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:37,144 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:37,144 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:37,145 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:37,145 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,145 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:37,145 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:37,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:37,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:37,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:37,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:37,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:37,149 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:37,149 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:37,149 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:37,149 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,149 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:37,150 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,150 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:37,150 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:37,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:37,151 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:37,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:37,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:37,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,153 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,155 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,155 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:37,155 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,155 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,155 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:37,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:37,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:37,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:37,155 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:37,155 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:37,156 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:37,156 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:37,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:37,156 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,156 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,156 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:37,156 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:37,256 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:37,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:37,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:37,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:37,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,263 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:37,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:37,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:37,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:37,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,263 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,264 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,264 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:37,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:37,265 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:37,265 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,266 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:37,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:37,266 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:37,266 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:37,266 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:37,266 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:37,266 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:37,266 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:37,266 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:37,267 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:37,688 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cc54b236fc94419eb61f32f65c63f87a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cc54b236fc94419eb61f32f65c63f87a 2023-04-04 17:55:38,098 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/bffb5fb7dcfe4e28b7916550fbd00881 2023-04-04 17:55:38,110 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/bffb5fb7dcfe4e28b7916550fbd00881 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bffb5fb7dcfe4e28b7916550fbd00881 2023-04-04 17:55:38,115 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bffb5fb7dcfe4e28b7916550fbd00881, entries=1, sequenceid=33, filesize=4.9 K 2023-04-04 17:55:38,116 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 849ms, sequenceid=33, compaction requested=true 2023-04-04 17:55:38,116 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:38,116 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:38,116 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:38,117 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:38,117 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,117 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:38,117 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:38,118 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,118 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:38,119 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,119 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:38,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:38,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@608f0b2a[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:38,121 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:38,121 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,121 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:38,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:38,122 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:38,122 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,122 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:38,124 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:38,124 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:38,124 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:38,124 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:38,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:38,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:38,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:38,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:38,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:38,128 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:38,128 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:38,128 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:38,128 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,128 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:38,130 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,130 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:38,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,130 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:38,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:38,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:38,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:38,131 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:38,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:38,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,133 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,136 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:38,136 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,136 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:38,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:38,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:38,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:38,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:38,136 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:38,136 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:38,136 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,136 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:38,136 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,137 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:38,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:38,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:38,137 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,137 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,137 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,237 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:38,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:38,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:38,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:38,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,248 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:38,248 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:38,249 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:38,249 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:38,250 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,250 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,251 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:38,251 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:38,252 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,252 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:38,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:38,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,253 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:38,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:38,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:38,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:38,253 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:38,254 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:38,254 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:38,254 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:38,254 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:38,254 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:38,671 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090703e0977ce67d41559ee1dde0da4fb4f8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090703e0977ce67d41559ee1dde0da4fb4f8 2023-04-04 17:55:39,077 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/51ab5ad1e05646798566e29c59ea932f 2023-04-04 17:55:39,087 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/51ab5ad1e05646798566e29c59ea932f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/51ab5ad1e05646798566e29c59ea932f 2023-04-04 17:55:39,092 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/51ab5ad1e05646798566e29c59ea932f, entries=1, sequenceid=37, filesize=4.9 K 2023-04-04 17:55:39,093 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 839ms, sequenceid=37, compaction requested=true 2023-04-04 17:55:39,093 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:39,093 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:39,093 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:39,093 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:39,093 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,093 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:39,093 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:39,095 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,095 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:39,096 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,096 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:39,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:39,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:39,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:39,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65679260[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:39,098 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:39,098 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,099 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,099 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:39,099 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:39,099 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:39,099 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,100 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:39,101 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:39,101 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,101 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:39,101 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:39,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:39,104 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:39,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:39,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:39,104 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,104 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:39,106 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,106 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:39,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,106 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:39,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:39,107 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,109 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,111 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,111 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:39,112 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,112 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:39,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:39,112 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:39,112 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,112 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:39,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:39,112 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:39,112 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:39,112 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:39,112 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:39,112 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,113 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,113 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,212 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:39,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:39,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:39,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:39,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,223 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:39,223 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:39,223 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-04 17:55:39,224 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-04 17:55:39,224 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,224 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,226 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:39,226 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:39,227 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:39,227 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,228 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,229 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-04 17:55:39,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:39,229 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-04 17:55:39,229 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:39,229 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-04 17:55:39,229 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-04 17:55:39,229 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:39,229 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:39,230 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. started... 2023-04-04 17:55:39,230 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a3d3fb9dbe50c3b06556b7af58c1b61e 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-04 17:55:39,654 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f3f19d2bad244f289708140bec266e1a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120f3f19d2bad244f289708140bec266e1a 2023-04-04 17:55:40,065 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/68ef051f6720419989072bf954410240 2023-04-04 17:55:40,071 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/68ef051f6720419989072bf954410240 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/68ef051f6720419989072bf954410240 2023-04-04 17:55:40,075 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/68ef051f6720419989072bf954410240, entries=1, sequenceid=41, filesize=4.9 K 2023-04-04 17:55:40,076 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a3d3fb9dbe50c3b06556b7af58c1b61e in 846ms, sequenceid=41, compaction requested=true 2023-04-04 17:55:40,076 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:40,076 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:40,076 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-04 17:55:40,076 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-04 17:55:40,076 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,076 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-04 17:55:40,076 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-04 17:55:40,078 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:40,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:40,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,078 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:40,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:40,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:40,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:40,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-04 17:55:40,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773f3b13[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:40,079 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-04 17:55:40,079 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,080 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-04 17:55:40,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-04 17:55:40,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:40,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,080 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:40,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-04 17:55:40,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:40,081 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-04 17:55:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:40,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:40,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:40,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-04 17:55:40,083 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-04 17:55:40,083 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:40,083 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:40,083 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,083 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:40,084 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,084 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:40,084 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:40,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:40,084 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:40,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,085 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:40,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,086 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,086 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:40,086 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,086 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:40,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:40,086 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:40,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:40,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-04 17:55:40,086 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-04 17:55:40,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:40,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:40,087 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:40,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:40,087 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,087 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,087 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,087 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:40,087 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:40,187 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:40,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:40,191 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-04-04 17:55:40,194 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:55:40,196 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:55:40,197 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:55:40,197 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631540197 2023-04-04 17:55:40,198 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-04 17:55:40,199 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-04-04 17:55:40,199 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:40,200 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x27fc0100 to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:55:40,204 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17af2b5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:55:40,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,037 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037c3397e7cfdc483ead6ef5579876ea76 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037c3397e7cfdc483ead6ef5579876ea76 2023-04-04 17:55:41,039 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:41,054 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:55:41,055 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:55:41,062 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:55:41,063 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:55:41,071 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 first=Optional[r5] last=Optional[r6] 2023-04-04 17:55:41,071 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0}] 2023-04-04 17:55:41,079 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 for inclusion in a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:41,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-04-04 17:55:41,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:55:41,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:41,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hutq7qj0md8ipv5fnujhcnucrdnrer2p6dgp939jljm23lpaic8q51vb7hoqvl8o/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 2023-04-04 17:55:41,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hutq7qj0md8ipv5fnujhcnucrdnrer2p6dgp939jljm23lpaic8q51vb7hoqvl8o/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_ 2023-04-04 17:55:41,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hutq7qj0md8ipv5fnujhcnucrdnrer2p6dgp939jljm23lpaic8q51vb7hoqvl8o/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_ - updating store file list. 2023-04-04 17:55:41,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_ into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:41,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hutq7qj0md8ipv5fnujhcnucrdnrer2p6dgp939jljm23lpaic8q51vb7hoqvl8o/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_) 2023-04-04 17:55:41,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hutq7qj0md8ipv5fnujhcnucrdnrer2p6dgp939jljm23lpaic8q51vb7hoqvl8o/family1/c46c73063cbc4c12b7a3b9f8f8d03fc0 2023-04-04 17:55:41,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-04 17:55:41,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-04 17:55:41,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(1912): a3d3fb9dbe50c3b06556b7af58c1b61e/family1 is initiating minor compaction 2023-04-04 17:55:41,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@731f9013; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-04 17:55:41,095 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a3d3fb9dbe50c3b06556b7af58c1b61e/family1 in testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:41,095 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bcc87dabbfa44f9ea3c7f96db5011f0e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/b8659f1641e740c58c073721d818ff61, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/7e2cc970da8a4a07bbbf09e2538c11e5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5c6e52da878a4d168eff3beb7611cc86, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/9618a1a5f37547bbbfa37257b04fa991, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bb49f5b1ba7047459954eb18b0cdbb66, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bffb5fb7dcfe4e28b7916550fbd00881, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/51ab5ad1e05646798566e29c59ea932f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/68ef051f6720419989072bf954410240, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp, totalSize=49.7 K 2023-04-04 17:55:41,095 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting bcc87dabbfa44f9ea3c7f96db5011f0e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-04 17:55:41,095 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting b8659f1641e740c58c073721d818ff61, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-04 17:55:41,095 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 7e2cc970da8a4a07bbbf09e2538c11e5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-04 17:55:41,095 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 5c6e52da878a4d168eff3beb7611cc86, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-04 17:55:41,095 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 9618a1a5f37547bbbfa37257b04fa991, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-04 17:55:41,095 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting bb49f5b1ba7047459954eb18b0cdbb66, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-04 17:55:41,096 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting bffb5fb7dcfe4e28b7916550fbd00881, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-04 17:55:41,096 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 51ab5ad1e05646798566e29c59ea932f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-04 17:55:41,096 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 68ef051f6720419989072bf954410240, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-04 17:55:41,096 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 23363c75e56141b48e4c544d6ed6f15e_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-04 17:55:41,097 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:41,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:41,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101ebff5104699b488eb1dd5af1dde36af2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101ebff5104699b488eb1dd5af1dde36af2 2023-04-04 17:55:41,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cc54b236fc94419eb61f32f65c63f87a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cc54b236fc94419eb61f32f65c63f87a 2023-04-04 17:55:41,100 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-04-04 17:55:41,100 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-04-04 17:55:41,101 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,101 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,120 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): a3d3fb9dbe50c3b06556b7af58c1b61e#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:41,540 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/aafd621d91564d1386d7d611a8f287ff as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/aafd621d91564d1386d7d611a8f287ff 2023-04-04 17:55:41,542 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313896880f2acd41999d73f685940afea8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512313896880f2acd41999d73f685940afea8 2023-04-04 17:55:41,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:41,544 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a3d3fb9dbe50c3b06556b7af58c1b61e/family1 of a3d3fb9dbe50c3b06556b7af58c1b61e into aafd621d91564d1386d7d611a8f287ff(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:41,544 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:41,544 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1680630941095; duration=0sec 2023-04-04 17:55:41,544 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:55:41,567 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7df972a7517b4812a9daf5e11db939ed first=Optional[r1] last=Optional[r4] 2023-04-04 17:55:41,568 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7df972a7517b4812a9daf5e11db939ed}] 2023-04-04 17:55:41,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7df972a7517b4812a9daf5e11db939ed for inclusion in a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:41,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-04-04 17:55:41,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:55:41,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:41,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7df972a7517b4812a9daf5e11db939ed to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8q44pt6s67b0vf4bt06ojams8emcmqk8e37ap07g3aooptdsmbohjq0ib00cdeua/family1/7df972a7517b4812a9daf5e11db939ed 2023-04-04 17:55:41,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8q44pt6s67b0vf4bt06ojams8emcmqk8e37ap07g3aooptdsmbohjq0ib00cdeua/family1/7df972a7517b4812a9daf5e11db939ed as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_ 2023-04-04 17:55:41,576 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8q44pt6s67b0vf4bt06ojams8emcmqk8e37ap07g3aooptdsmbohjq0ib00cdeua/family1/7df972a7517b4812a9daf5e11db939ed into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_ - updating store file list. 2023-04-04 17:55:41,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_ into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:41,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8q44pt6s67b0vf4bt06ojams8emcmqk8e37ap07g3aooptdsmbohjq0ib00cdeua/family1/7df972a7517b4812a9daf5e11db939ed into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_) 2023-04-04 17:55:41,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8q44pt6s67b0vf4bt06ojams8emcmqk8e37ap07g3aooptdsmbohjq0ib00cdeua/family1/7df972a7517b4812a9daf5e11db939ed 2023-04-04 17:55:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-04 17:55:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-04 17:55:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(1912): a3d3fb9dbe50c3b06556b7af58c1b61e/family1 is initiating minor compaction (all files) 2023-04-04 17:55:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@42b87c8d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:55:41,581 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a3d3fb9dbe50c3b06556b7af58c1b61e/family1 in testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:55:41,581 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5bfe3333c1974a129a1694309ab3fe22, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/aafd621d91564d1386d7d611a8f287ff, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp, totalSize=178.1 K 2023-04-04 17:55:41,581 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting 5bfe3333c1974a129a1694309ab3fe22, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809546 2023-04-04 17:55:41,581 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting aafd621d91564d1386d7d611a8f287ff, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209546 2023-04-04 17:55:41,582 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] compactions.Compactor(207): Compacting fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965209546 2023-04-04 17:55:41,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:41,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:41,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120122ac97549d2d486eb241b5a2a19090cc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120122ac97549d2d486eb241b5a2a19090cc 2023-04-04 17:55:41,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058a48d2e19bfc488fa276d9ab1b744436 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058a48d2e19bfc488fa276d9ab1b744436 2023-04-04 17:55:41,586 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122877a36391ca5d4611a6b4dd3241cf0f6d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122877a36391ca5d4611a6b4dd3241cf0f6d 2023-04-04 17:55:41,588 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d53df243f1a446c8a4b795ff257da1f1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d53df243f1a446c8a4b795ff257da1f1 2023-04-04 17:55:41,588 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-04-04 17:55:41,588 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-04-04 17:55:41,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,595 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] throttle.PressureAwareThroughputController(145): a3d3fb9dbe50c3b06556b7af58c1b61e#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:41,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bcc87dabbfa44f9ea3c7f96db5011f0e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/b8659f1641e740c58c073721d818ff61, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/7e2cc970da8a4a07bbbf09e2538c11e5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5c6e52da878a4d168eff3beb7611cc86, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/9618a1a5f37547bbbfa37257b04fa991, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bb49f5b1ba7047459954eb18b0cdbb66, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bffb5fb7dcfe4e28b7916550fbd00881, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/51ab5ad1e05646798566e29c59ea932f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/68ef051f6720419989072bf954410240, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_] to archive 2023-04-04 17:55:41,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:41,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bcc87dabbfa44f9ea3c7f96db5011f0e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bcc87dabbfa44f9ea3c7f96db5011f0e 2023-04-04 17:55:41,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/b8659f1641e740c58c073721d818ff61 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/b8659f1641e740c58c073721d818ff61 2023-04-04 17:55:41,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/7e2cc970da8a4a07bbbf09e2538c11e5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/7e2cc970da8a4a07bbbf09e2538c11e5 2023-04-04 17:55:41,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5c6e52da878a4d168eff3beb7611cc86 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5c6e52da878a4d168eff3beb7611cc86 2023-04-04 17:55:41,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/9618a1a5f37547bbbfa37257b04fa991 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/9618a1a5f37547bbbfa37257b04fa991 2023-04-04 17:55:41,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bb49f5b1ba7047459954eb18b0cdbb66 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bb49f5b1ba7047459954eb18b0cdbb66 2023-04-04 17:55:41,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bffb5fb7dcfe4e28b7916550fbd00881 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/bffb5fb7dcfe4e28b7916550fbd00881 2023-04-04 17:55:41,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/51ab5ad1e05646798566e29c59ea932f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/51ab5ad1e05646798566e29c59ea932f 2023-04-04 17:55:41,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/68ef051f6720419989072bf954410240 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/68ef051f6720419989072bf954410240 2023-04-04 17:55:41,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/23363c75e56141b48e4c544d6ed6f15e_SeqId_44_ 2023-04-04 17:55:41,638 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113042bb3eac534b44fe9a539851de108c2d to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113042bb3eac534b44fe9a539851de108c2d 2023-04-04 17:55:41,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:41,666 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34959f3eab054240878ce00c42001dcf first=Optional[r00] last=Optional[r8] 2023-04-04 17:55:41,666 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34959f3eab054240878ce00c42001dcf}] 2023-04-04 17:55:41,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34959f3eab054240878ce00c42001dcf for inclusion in a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:41,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-04-04 17:55:41,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last= 2023-04-04 17:55:41,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:41,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34959f3eab054240878ce00c42001dcf to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ndo2btbakcpa8v55kdea7i52fv3pbb2b7dunfl1cg4ev2j1kdlqjdahnkc8es7ok/family1/34959f3eab054240878ce00c42001dcf 2023-04-04 17:55:41,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ndo2btbakcpa8v55kdea7i52fv3pbb2b7dunfl1cg4ev2j1kdlqjdahnkc8es7ok/family1/34959f3eab054240878ce00c42001dcf as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/dba850fb48054722a6c3860ec813855c_SeqId_49_ 2023-04-04 17:55:41,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ndo2btbakcpa8v55kdea7i52fv3pbb2b7dunfl1cg4ev2j1kdlqjdahnkc8es7ok/family1/34959f3eab054240878ce00c42001dcf into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/dba850fb48054722a6c3860ec813855c_SeqId_49_ - updating store file list. 2023-04-04 17:55:41,676 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/dba850fb48054722a6c3860ec813855c_SeqId_49_ into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 2023-04-04 17:55:41,676 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ndo2btbakcpa8v55kdea7i52fv3pbb2b7dunfl1cg4ev2j1kdlqjdahnkc8es7ok/family1/34959f3eab054240878ce00c42001dcf into a3d3fb9dbe50c3b06556b7af58c1b61e/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/dba850fb48054722a6c3860ec813855c_SeqId_49_) 2023-04-04 17:55:41,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ndo2btbakcpa8v55kdea7i52fv3pbb2b7dunfl1cg4ev2j1kdlqjdahnkc8es7ok/family1/34959f3eab054240878ce00c42001dcf 2023-04-04 17:55:41,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:41,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:41,679 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120f3f19d2bad244f289708140bec266e1a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120f3f19d2bad244f289708140bec266e1a 2023-04-04 17:55:41,680 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112850c15292c9c9412c972023cf532a61b6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112850c15292c9c9412c972023cf532a61b6 2023-04-04 17:55:41,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511308694c6b7d10d4eceb4ba068d6ee5a858 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511308694c6b7d10d4eceb4ba068d6ee5a858 2023-04-04 17:55:41,681 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-04-04 17:55:41,681 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-04 17:55:41,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-04 17:55:41,681 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-04 17:55:41,681 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:55:41,683 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-04 17:55:41,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4900 sec 2023-04-04 17:55:41,870 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=263 (was 247) - Thread LEAK? -, OpenFileDescriptor=657 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 134), ProcessCount=173 (was 173), AvailableMemoryMB=6681 (was 6692) 2023-04-04 17:55:41,883 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=263, OpenFileDescriptor=657, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=173, AvailableMemoryMB=6680 2023-04-04 17:55:41,902 DEBUG [Listener at localhost.localdomain/45763] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-04-04 17:55:41,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10_\xFF\x07\x000\x05\xEB\x09\x80\x19\xF1\x85\xFB\x8C\xAE\xCC"\x10\x9A\x09g3D0\x17\xEB:\xD7\x80\xD41\xCE\x88F*\x10\xA3\xB5\x15\xC7+\x06\x93\x0Fu#x\xB9~\xEA\x10#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-04 17:55:41,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-04-04 17:55:41,952 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-04-04 17:55:41,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(697): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-04-04 17:55:41,953 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-04 17:55:41,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-04 17:55:41,954 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:41,954 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:41,958 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c empty. 2023-04-04 17:55:41,958 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:41,958 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c empty. 2023-04-04 17:55:41,958 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:41,958 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93 empty. 2023-04-04 17:55:41,958 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:41,958 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:41,959 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-04-04 17:55:42,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-04 17:55:42,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-04 17:55:42,372 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-04-04 17:55:42,374 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6e5dc09ac5ea944eb373dc3ef78aea3c, NAME => 'testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10_\xFF\x07\x000\x05\xEB\x09\x80\x19\xF1\x85\xFB\x8C\xAE\xCC"\x10\x9A\x09g3D0\x17\xEB:\xD7\x80\xD41\xCE\x88F*\x10\xA3\xB5\x15\xC7+\x06\x93\x0Fu#x\xB9~\xEA\x10#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:55:42,374 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9a87c8617e1aab24933a3b43a4aadb93, NAME => 'testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10_\xFF\x07\x000\x05\xEB\x09\x80\x19\xF1\x85\xFB\x8C\xAE\xCC"\x10\x9A\x09g3D0\x17\xEB:\xD7\x80\xD41\xCE\x88F*\x10\xA3\xB5\x15\xC7+\x06\x93\x0Fu#x\xB9~\xEA\x10#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:55:42,375 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0dc260f7a393c4816ece7b947e7b7c7c, NAME => 'testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10_\xFF\x07\x000\x05\xEB\x09\x80\x19\xF1\x85\xFB\x8C\xAE\xCC"\x10\x9A\x09g3D0\x17\xEB:\xD7\x80\xD41\xCE\x88F*\x10\xA3\xB5\x15\xC7+\x06\x93\x0Fu#x\xB9~\xEA\x10#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/.tmp 2023-04-04 17:55:42,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 0dc260f7a393c4816ece7b947e7b7c7c, disabling compactions & flushes 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 6e5dc09ac5ea944eb373dc3ef78aea3c, disabling compactions & flushes 2023-04-04 17:55:42,788 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:42,788 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. after waiting 0 ms 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 9a87c8617e1aab24933a3b43a4aadb93, disabling compactions & flushes 2023-04-04 17:55:42,788 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. after waiting 0 ms 2023-04-04 17:55:42,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. after waiting 0 ms 2023-04-04 17:55:42,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:42,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:42,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:42,789 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:42,790 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-04-04 17:55:42,791 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680630942791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630942791"}]},"ts":"1680630942791"} 2023-04-04 17:55:42,791 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630942791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630942791"}]},"ts":"1680630942791"} 2023-04-04 17:55:42,791 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630942791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680630942791"}]},"ts":"1680630942791"} 2023-04-04 17:55:42,799 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-04 17:55:42,800 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-04 17:55:42,800 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630942800"}]},"ts":"1680630942800"} 2023-04-04 17:55:42,800 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-04-04 17:55:42,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6e5dc09ac5ea944eb373dc3ef78aea3c, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0dc260f7a393c4816ece7b947e7b7c7c, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9a87c8617e1aab24933a3b43a4aadb93, ASSIGN}] 2023-04-04 17:55:42,804 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0dc260f7a393c4816ece7b947e7b7c7c, ASSIGN 2023-04-04 17:55:42,804 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6e5dc09ac5ea944eb373dc3ef78aea3c, ASSIGN 2023-04-04 17:55:42,804 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9a87c8617e1aab24933a3b43a4aadb93, ASSIGN 2023-04-04 17:55:42,804 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0dc260f7a393c4816ece7b947e7b7c7c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:55:42,804 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9a87c8617e1aab24933a3b43a4aadb93, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:55:42,805 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6e5dc09ac5ea944eb373dc3ef78aea3c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46251,1680630785259; forceNewPlan=false, retain=false 2023-04-04 17:55:42,813 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/.tmp/family1/25cd48af68f34aa493e3226acfe53260 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/25cd48af68f34aa493e3226acfe53260 2023-04-04 17:55:42,816 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a3d3fb9dbe50c3b06556b7af58c1b61e/family1 of a3d3fb9dbe50c3b06556b7af58c1b61e into 25cd48af68f34aa493e3226acfe53260(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:42,816 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:55:42,816 INFO [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1680630941580; duration=1sec 2023-04-04 17:55:42,816 DEBUG [RS:0;jenkins-hbase17:46251-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-04 17:55:42,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5bfe3333c1974a129a1694309ab3fe22, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/aafd621d91564d1386d7d611a8f287ff, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_] to archive 2023-04-04 17:55:42,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:42,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5bfe3333c1974a129a1694309ab3fe22 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/5bfe3333c1974a129a1694309ab3fe22 2023-04-04 17:55:42,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/aafd621d91564d1386d7d611a8f287ff to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/aafd621d91564d1386d7d611a8f287ff 2023-04-04 17:55:42,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_ to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/family1/fba6d52d81b34a5d97088ddb8c3fe91d_SeqId_47_ 2023-04-04 17:55:42,956 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0dc260f7a393c4816ece7b947e7b7c7c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:42,956 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=9a87c8617e1aab24933a3b43a4aadb93, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:42,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680630942956"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630942956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630942956"}]},"ts":"1680630942956"} 2023-04-04 17:55:42,956 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=6e5dc09ac5ea944eb373dc3ef78aea3c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:42,956 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630942956"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630942956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630942956"}]},"ts":"1680630942956"} 2023-04-04 17:55:42,956 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630942956"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1680630942956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680630942956"}]},"ts":"1680630942956"} 2023-04-04 17:55:42,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 0dc260f7a393c4816ece7b947e7b7c7c, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:42,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 9a87c8617e1aab24933a3b43a4aadb93, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:42,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 6e5dc09ac5ea944eb373dc3ef78aea3c, server=jenkins-hbase17.apache.org,46251,1680630785259}] 2023-04-04 17:55:43,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-04 17:55:43,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:43,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e5dc09ac5ea944eb373dc3ef78aea3c, NAME => 'testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c.', STARTKEY => '', ENDKEY => '1'} 2023-04-04 17:55:43,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:43,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,129 INFO [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,131 DEBUG [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1 2023-04-04 17:55:43,131 DEBUG [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1 2023-04-04 17:55:43,131 INFO [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e5dc09ac5ea944eb373dc3ef78aea3c columnFamilyName family1 2023-04-04 17:55:43,132 INFO [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] regionserver.HStore(310): Store=6e5dc09ac5ea944eb373dc3ef78aea3c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:43,133 INFO [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,134 DEBUG [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2 2023-04-04 17:55:43,134 DEBUG [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2 2023-04-04 17:55:43,134 INFO [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e5dc09ac5ea944eb373dc3ef78aea3c columnFamilyName family2 2023-04-04 17:55:43,135 INFO [StoreOpener-6e5dc09ac5ea944eb373dc3ef78aea3c-1] regionserver.HStore(310): Store=6e5dc09ac5ea944eb373dc3ef78aea3c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:43,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:43,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:55:43,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:55:43,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 6e5dc09ac5ea944eb373dc3ef78aea3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60886190, jitterRate=-0.09272506833076477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:43,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:43,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c., pid=122, masterSystemTime=1680630943108 2023-04-04 17:55:43,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:43,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:43,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:43,142 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=6e5dc09ac5ea944eb373dc3ef78aea3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:43,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0dc260f7a393c4816ece7b947e7b7c7c, NAME => 'testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c.', STARTKEY => '1', ENDKEY => '2'} 2023-04-04 17:55:43,142 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630943142"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630943142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630943142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630943142"}]},"ts":"1680630943142"} 2023-04-04 17:55:43,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:43,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-04-04 17:55:43,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 6e5dc09ac5ea944eb373dc3ef78aea3c, server=jenkins-hbase17.apache.org,46251,1680630785259 in 185 msec 2023-04-04 17:55:43,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6e5dc09ac5ea944eb373dc3ef78aea3c, ASSIGN in 342 msec 2023-04-04 17:55:43,161 INFO [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,163 DEBUG [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1 2023-04-04 17:55:43,163 DEBUG [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1 2023-04-04 17:55:43,163 INFO [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dc260f7a393c4816ece7b947e7b7c7c columnFamilyName family1 2023-04-04 17:55:43,164 INFO [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] regionserver.HStore(310): Store=0dc260f7a393c4816ece7b947e7b7c7c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:43,164 INFO [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,165 DEBUG [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2 2023-04-04 17:55:43,165 DEBUG [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2 2023-04-04 17:55:43,165 INFO [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dc260f7a393c4816ece7b947e7b7c7c columnFamilyName family2 2023-04-04 17:55:43,166 INFO [StoreOpener-0dc260f7a393c4816ece7b947e7b7c7c-1] regionserver.HStore(310): Store=0dc260f7a393c4816ece7b947e7b7c7c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:43,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:43,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:55:43,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:55:43,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0dc260f7a393c4816ece7b947e7b7c7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73132996, jitterRate=0.08976656198501587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:43,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:43,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c., pid=120, masterSystemTime=1680630943108 2023-04-04 17:55:43,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:43,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:43,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:43,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a87c8617e1aab24933a3b43a4aadb93, NAME => 'testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93.', STARTKEY => '2', ENDKEY => ''} 2023-04-04 17:55:43,172 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0dc260f7a393c4816ece7b947e7b7c7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:43,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-04 17:55:43,172 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680630943172"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630943172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630943172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630943172"}]},"ts":"1680630943172"} 2023-04-04 17:55:43,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-04-04 17:55:43,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 0dc260f7a393c4816ece7b947e7b7c7c, server=jenkins-hbase17.apache.org,46251,1680630785259 in 216 msec 2023-04-04 17:55:43,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0dc260f7a393c4816ece7b947e7b7c7c, ASSIGN in 372 msec 2023-04-04 17:55:43,190 INFO [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,192 DEBUG [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1 2023-04-04 17:55:43,192 DEBUG [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1 2023-04-04 17:55:43,192 INFO [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a87c8617e1aab24933a3b43a4aadb93 columnFamilyName family1 2023-04-04 17:55:43,192 INFO [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] regionserver.HStore(310): Store=9a87c8617e1aab24933a3b43a4aadb93/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:43,193 INFO [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,194 DEBUG [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2 2023-04-04 17:55:43,194 DEBUG [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2 2023-04-04 17:55:43,194 INFO [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a87c8617e1aab24933a3b43a4aadb93 columnFamilyName family2 2023-04-04 17:55:43,194 INFO [StoreOpener-9a87c8617e1aab24933a3b43a4aadb93-1] regionserver.HStore(310): Store=9a87c8617e1aab24933a3b43a4aadb93/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-04 17:55:43,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-04 17:55:43,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:55:43,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-04 17:55:43,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9a87c8617e1aab24933a3b43a4aadb93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66912305, jitterRate=-0.0029289573431015015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-04 17:55:43,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:43,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93., pid=121, masterSystemTime=1680630943108 2023-04-04 17:55:43,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:43,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:43,201 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=9a87c8617e1aab24933a3b43a4aadb93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:43,201 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680630943201"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1680630943201"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680630943201"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680630943201"}]},"ts":"1680630943201"} 2023-04-04 17:55:43,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-04-04 17:55:43,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 9a87c8617e1aab24933a3b43a4aadb93, server=jenkins-hbase17.apache.org,46251,1680630785259 in 244 msec 2023-04-04 17:55:43,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-04-04 17:55:43,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9a87c8617e1aab24933a3b43a4aadb93, ASSIGN in 402 msec 2023-04-04 17:55:43,205 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-04 17:55:43,205 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680630943205"}]},"ts":"1680630943205"} 2023-04-04 17:55:43,206 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-04-04 17:55:43,209 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-04-04 17:55:43,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2600 sec 2023-04-04 17:55:44,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-04 17:55:44,057 INFO [Listener at localhost.localdomain/45763] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-04-04 17:55:44,063 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:44,064 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:44,064 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:44,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:44,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-04 17:55:44,067 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-04 17:55:44,067 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:44,067 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-04 17:55:44,068 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-04 17:55:44,068 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:44,068 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:44,069 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:44,069 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:44,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:44,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:44,069 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:44,069 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:44,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:44,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:44,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:44,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:44,070 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-04 17:55:44,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-04 17:55:44,070 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-04 17:55:44,070 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:44,070 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-04 17:55:44,070 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:44,070 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. started... 2023-04-04 17:55:44,070 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:44,070 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:44,071 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:44,070 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. started... 2023-04-04 17:55:44,070 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:44,071 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0dc260f7a393c4816ece7b947e7b7c7c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:55:44,072 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6e5dc09ac5ea944eb373dc3ef78aea3c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:55:44,071 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. started... 2023-04-04 17:55:44,072 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9a87c8617e1aab24933a3b43a4aadb93 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-04 17:55:44,114 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304046ddcb666855540a0bdd204789213e991 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304046ddcb666855540a0bdd204789213e991 2023-04-04 17:55:44,514 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404a31597812a684a62a69afa7ad2659561 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230404a31597812a684a62a69afa7ad2659561 2023-04-04 17:55:44,517 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040438448891c3ef4a17b208ddc46b9b2d5b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040438448891c3ef4a17b208ddc46b9b2d5b 2023-04-04 17:55:44,528 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/396be4e2e1d1438397cbca714879a1a9 2023-04-04 17:55:44,534 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/b166a0564e18463a9aec345aba43f836 2023-04-04 17:55:44,535 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/15defb89b2ec452ba3bddedb51cf034f 2023-04-04 17:55:44,565 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304044b1faafc149b42589fc18d2cff1df781 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202304044b1faafc149b42589fc18d2cff1df781 2023-04-04 17:55:44,976 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/a32e82aeb8514b0a8f217cb1cf6155e1 2023-04-04 17:55:44,979 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/396be4e2e1d1438397cbca714879a1a9 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/396be4e2e1d1438397cbca714879a1a9 2023-04-04 17:55:44,989 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404c2d7ae2216904c93b7493ab2b6930c37 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230404c2d7ae2216904c93b7493ab2b6930c37 2023-04-04 17:55:44,989 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040467db234279564293a01a596be9d93ef6 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023040467db234279564293a01a596be9d93ef6 2023-04-04 17:55:44,994 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/d4bbd8577e274c5198cff0ec9f01d516 2023-04-04 17:55:44,994 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/1d2a98d1ee414dc19d5c65c096ef94fa 2023-04-04 17:55:44,997 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/b166a0564e18463a9aec345aba43f836 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/b166a0564e18463a9aec345aba43f836 2023-04-04 17:55:45,027 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/15defb89b2ec452ba3bddedb51cf034f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/15defb89b2ec452ba3bddedb51cf034f 2023-04-04 17:55:45,028 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/396be4e2e1d1438397cbca714879a1a9, entries=4, sequenceid=5, filesize=5.5 K 2023-04-04 17:55:45,028 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/b166a0564e18463a9aec345aba43f836, entries=4, sequenceid=5, filesize=5.5 K 2023-04-04 17:55:45,029 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/a32e82aeb8514b0a8f217cb1cf6155e1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/a32e82aeb8514b0a8f217cb1cf6155e1 2023-04-04 17:55:45,029 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/1d2a98d1ee414dc19d5c65c096ef94fa as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/1d2a98d1ee414dc19d5c65c096ef94fa 2023-04-04 17:55:45,032 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/1d2a98d1ee414dc19d5c65c096ef94fa, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:55:45,032 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/a32e82aeb8514b0a8f217cb1cf6155e1, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:55:45,032 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0dc260f7a393c4816ece7b947e7b7c7c in 961ms, sequenceid=5, compaction requested=false 2023-04-04 17:55:45,032 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6e5dc09ac5ea944eb373dc3ef78aea3c in 960ms, sequenceid=5, compaction requested=false 2023-04-04 17:55:45,032 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-04-04 17:55:45,032 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-04-04 17:55:45,034 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:45,034 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:45,034 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:45,034 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:45,034 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:45,034 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:45,055 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/15defb89b2ec452ba3bddedb51cf034f, entries=4, sequenceid=5, filesize=5.5 K 2023-04-04 17:55:45,056 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/d4bbd8577e274c5198cff0ec9f01d516 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/d4bbd8577e274c5198cff0ec9f01d516 2023-04-04 17:55:45,059 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/d4bbd8577e274c5198cff0ec9f01d516, entries=2, sequenceid=5, filesize=5.1 K 2023-04-04 17:55:45,060 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9a87c8617e1aab24933a3b43a4aadb93 in 988ms, sequenceid=5, compaction requested=false 2023-04-04 17:55:45,060 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:45,060 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:45,060 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:45,060 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:45,060 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,060 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-04 17:55:45,060 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-04 17:55:45,061 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,061 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:45,061 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,061 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:45,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-04 17:55:45,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-04 17:55:45,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe0bb80[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:45,062 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,063 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,063 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-04 17:55:45,063 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-04 17:55:45,063 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,063 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:45,063 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:45,064 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-04 17:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:45,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:45,064 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-04 17:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-04 17:55:45,065 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-04 17:55:45,065 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:45,065 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:45,065 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-04 17:55:45,065 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:45,066 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,066 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:45,066 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,066 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:45,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:45,067 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,068 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,068 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:45,068 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:45,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-04-04 17:55:45,068 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:45,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:45,068 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-04 17:55:45,069 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:45,068 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:45,069 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:45,069 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,069 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:45,069 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:45,069 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:45,069 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,069 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:45,169 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:45,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:45,171 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:45,171 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:45,171 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:45,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:45,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:45,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-04 17:55:45,175 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-04 17:55:45,175 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:45,175 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-04 17:55:45,175 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-04 17:55:45,175 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,175 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:45,176 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,176 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:45,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:45,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:45,176 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:45,176 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:45,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:45,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:45,177 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-04 17:55:45,177 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-04-04 17:55:45,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-04 17:55:45,177 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-04 17:55:45,177 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:45,177 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-04 17:55:45,177 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:45,177 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:45,177 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:45,178 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:45,177 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:45,177 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. started... 2023-04-04 17:55:45,178 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. started... 2023-04-04 17:55:45,178 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. started... 2023-04-04 17:55:45,178 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9a87c8617e1aab24933a3b43a4aadb93 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:55:45,178 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6e5dc09ac5ea944eb373dc3ef78aea3c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:55:45,178 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0dc260f7a393c4816ece7b947e7b7c7c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-04 17:55:45,250 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404cc35d9139e4c4127ade10fdb30d71302 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230404cc35d9139e4c4127ade10fdb30d71302 2023-04-04 17:55:45,653 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304046bb43c12beb149b594bc615b0c9bc87f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304046bb43c12beb149b594bc615b0c9bc87f 2023-04-04 17:55:45,653 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304040e498031b65847e1bd80a58628b609b5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304040e498031b65847e1bd80a58628b609b5 2023-04-04 17:55:45,663 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/c2901ecc728340fcb35b1acf99479987 2023-04-04 17:55:46,073 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/de7465ad4e8e4366b6061e43101db0f8 2023-04-04 17:55:46,074 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:55:46,074 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27fc0100 to 127.0.0.1:61441 2023-04-04 17:55:46,074 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:55:46,074 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:55:46,074 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ae2c1dd to 127.0.0.1:61441 2023-04-04 17:55:46,074 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:55:46,075 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/121d656054514d60b75f6b043d7fa736 2023-04-04 17:55:46,095 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304047dfcab867809407b895fae07562ef14e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202304047dfcab867809407b895fae07562ef14e 2023-04-04 17:55:46,500 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/bc85dcf76d5e4c87aadfcb64789750cc 2023-04-04 17:55:46,504 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/c2901ecc728340fcb35b1acf99479987 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/c2901ecc728340fcb35b1acf99479987 2023-04-04 17:55:46,518 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304048d48a0e202cf4c4d8dd54bba4ea8ec49 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202304048d48a0e202cf4c4d8dd54bba4ea8ec49 2023-04-04 17:55:46,518 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040483dd40c3ba224bc79e3e1f29462f8bf8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023040483dd40c3ba224bc79e3e1f29462f8bf8 2023-04-04 17:55:46,538 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/c2901ecc728340fcb35b1acf99479987, entries=4, sequenceid=9, filesize=5.5 K 2023-04-04 17:55:46,539 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/bc85dcf76d5e4c87aadfcb64789750cc as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/bc85dcf76d5e4c87aadfcb64789750cc 2023-04-04 17:55:46,544 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/bc85dcf76d5e4c87aadfcb64789750cc, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:55:46,545 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0dc260f7a393c4816ece7b947e7b7c7c in 1366ms, sequenceid=9, compaction requested=false 2023-04-04 17:55:46,545 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:46,545 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:46,545 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:46,931 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/9442872a6a3d447e9d3d3dd732d7acd9 2023-04-04 17:55:46,931 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/0685f3ff62744d38b4922c1025608d2a 2023-04-04 17:55:46,934 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/121d656054514d60b75f6b043d7fa736 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/121d656054514d60b75f6b043d7fa736 2023-04-04 17:55:46,935 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/de7465ad4e8e4366b6061e43101db0f8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/de7465ad4e8e4366b6061e43101db0f8 2023-04-04 17:55:46,955 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/de7465ad4e8e4366b6061e43101db0f8, entries=4, sequenceid=9, filesize=5.5 K 2023-04-04 17:55:46,955 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/121d656054514d60b75f6b043d7fa736, entries=4, sequenceid=9, filesize=5.5 K 2023-04-04 17:55:46,956 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/9442872a6a3d447e9d3d3dd732d7acd9 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/9442872a6a3d447e9d3d3dd732d7acd9 2023-04-04 17:55:46,956 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/0685f3ff62744d38b4922c1025608d2a as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/0685f3ff62744d38b4922c1025608d2a 2023-04-04 17:55:46,959 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/9442872a6a3d447e9d3d3dd732d7acd9, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:55:46,959 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/0685f3ff62744d38b4922c1025608d2a, entries=2, sequenceid=9, filesize=5.1 K 2023-04-04 17:55:46,960 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6e5dc09ac5ea944eb373dc3ef78aea3c in 1782ms, sequenceid=9, compaction requested=false 2023-04-04 17:55:46,960 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9a87c8617e1aab24933a3b43a4aadb93 in 1782ms, sequenceid=9, compaction requested=false 2023-04-04 17:55:46,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:46,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:46,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:46,960 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:46,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:46,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:46,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:46,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-04 17:55:46,960 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-04 17:55:46,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,961 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:46,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:46,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,961 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:46,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:46,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:46,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:46,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:46,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-04 17:55:46,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57ae3f0d[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:46,963 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-04 17:55:46,963 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,963 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,963 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-04 17:55:46,963 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,963 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:46,963 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-04 17:55:46,963 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:46,964 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-04 17:55:46,964 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,964 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:46,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:46,964 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-04 17:55:46,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:46,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:46,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:46,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:46,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:46,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:46,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:46,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-04 17:55:46,966 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-04 17:55:46,966 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:46,966 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:46,966 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-04 17:55:46,966 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:46,967 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:46,967 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:46,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:46,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:46,967 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:46,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:46,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:46,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:46,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:46,967 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:46,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:46,968 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:46,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:46,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:46,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:46,969 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-04 17:55:46,969 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:46,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:46,969 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:46,969 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:46,970 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:46,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:46,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:46,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-04-04 17:55:46,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:46,970 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:46,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:46,970 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:47,070 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:47,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:47,072 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:47,072 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:47,072 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:47,075 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:47,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:47,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-04 17:55:47,077 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-04 17:55:47,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:47,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-04 17:55:47,077 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-04 17:55:47,078 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:47,078 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:47,078 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:47,078 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:47,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:47,079 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:47,079 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:47,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:47,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-04 17:55:47,080 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-04-04 17:55:47,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-04 17:55:47,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-04 17:55:47,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:47,080 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-04 17:55:47,080 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:47,080 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. started... 2023-04-04 17:55:47,080 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0dc260f7a393c4816ece7b947e7b7c7c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:55:47,080 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:47,080 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. started... 2023-04-04 17:55:47,081 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6e5dc09ac5ea944eb373dc3ef78aea3c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:55:47,083 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:47,084 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:47,084 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:47,084 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. started... 2023-04-04 17:55:47,084 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9a87c8617e1aab24933a3b43a4aadb93 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-04 17:55:47,544 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040440ca20950ebc48ba88062ba97cf068f4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040440ca20950ebc48ba88062ba97cf068f4 2023-04-04 17:55:47,550 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304045dc271e18e4c47e09608e9008ab27305 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304045dc271e18e4c47e09608e9008ab27305 2023-04-04 17:55:47,554 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304047df420f008084438847c87d99fae7c6f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304047df420f008084438847c87d99fae7c6f 2023-04-04 17:55:47,577 WARN [DataStreamer for file /user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/ceb33668f14140b0a6d81a7465dc1600] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-04-04 17:55:47,578 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/ceb33668f14140b0a6d81a7465dc1600 2023-04-04 17:55:47,578 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/439b28331aab4036b2395c1e09f847a2 2023-04-04 17:55:47,979 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/e44af163207148f0bd2e63c5243c8170 2023-04-04 17:55:48,023 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404ad49700744114fa290cfd1445eac135c to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230404ad49700744114fa290cfd1445eac135c 2023-04-04 17:55:48,032 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/df413dc55d7a458f865aced3b2db881e 2023-04-04 17:55:48,035 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404200eadb949ba43c6bb3f6e7d2fa8fa99 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230404200eadb949ba43c6bb3f6e7d2fa8fa99 2023-04-04 17:55:48,035 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404f8666e9368ef437eae5dba3c3035c124 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230404f8666e9368ef437eae5dba3c3035c124 2023-04-04 17:55:48,039 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/585e6b9111b04f34a803eafdf7756291 2023-04-04 17:55:48,040 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/e44af163207148f0bd2e63c5243c8170 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/e44af163207148f0bd2e63c5243c8170 2023-04-04 17:55:48,045 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/439b28331aab4036b2395c1e09f847a2 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/439b28331aab4036b2395c1e09f847a2 2023-04-04 17:55:48,067 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/e44af163207148f0bd2e63c5243c8170, entries=4, sequenceid=13, filesize=5.5 K 2023-04-04 17:55:48,068 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/df413dc55d7a458f865aced3b2db881e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/df413dc55d7a458f865aced3b2db881e 2023-04-04 17:55:48,071 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/df413dc55d7a458f865aced3b2db881e, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:55:48,072 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0dc260f7a393c4816ece7b947e7b7c7c in 992ms, sequenceid=13, compaction requested=true 2023-04-04 17:55:48,072 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:48,072 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:48,072 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:48,073 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/439b28331aab4036b2395c1e09f847a2, entries=4, sequenceid=13, filesize=5.5 K 2023-04-04 17:55:48,074 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/585e6b9111b04f34a803eafdf7756291 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/585e6b9111b04f34a803eafdf7756291 2023-04-04 17:55:48,080 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/585e6b9111b04f34a803eafdf7756291, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:55:48,081 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9a87c8617e1aab24933a3b43a4aadb93 in 997ms, sequenceid=13, compaction requested=true 2023-04-04 17:55:48,081 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:48,081 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:48,081 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:48,440 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/f38e142400474d39ae65ed3bea5cc671 2023-04-04 17:55:48,449 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/ceb33668f14140b0a6d81a7465dc1600 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/ceb33668f14140b0a6d81a7465dc1600 2023-04-04 17:55:48,473 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/ceb33668f14140b0a6d81a7465dc1600, entries=4, sequenceid=13, filesize=5.5 K 2023-04-04 17:55:48,473 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/f38e142400474d39ae65ed3bea5cc671 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f38e142400474d39ae65ed3bea5cc671 2023-04-04 17:55:48,477 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f38e142400474d39ae65ed3bea5cc671, entries=2, sequenceid=13, filesize=5.1 K 2023-04-04 17:55:48,477 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6e5dc09ac5ea944eb373dc3ef78aea3c in 1397ms, sequenceid=13, compaction requested=true 2023-04-04 17:55:48,477 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:48,477 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:48,477 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:48,477 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:48,477 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,477 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-04 17:55:48,477 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-04 17:55:48,479 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,479 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:48,479 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,479 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:48,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:48,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-04 17:55:48,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e03430a[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:48,480 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-04 17:55:48,480 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,480 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,481 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-04 17:55:48,481 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-04 17:55:48,481 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:48,481 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,481 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:48,481 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-04 17:55:48,481 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:48,481 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,481 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-04 17:55:48,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:48,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-04 17:55:48,483 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-04 17:55:48,483 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:48,483 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:48,483 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-04 17:55:48,483 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:48,484 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,484 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:48,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,484 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:48,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:48,484 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,485 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,487 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:48,487 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:48,488 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:48,487 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:48,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-04 17:55:48,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:48,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:48,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:48,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:48,488 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,588 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:48,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:48,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:48,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:48,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. with WAL disabled. Data may be lost in the event of a crash. 2023-04-04 17:55:48,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:48,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:48,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-04 17:55:48,601 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-04 17:55:48,601 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:48,601 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-04 17:55:48,601 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-04 17:55:48,602 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,602 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:48,603 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:48,603 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:48,604 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:48,604 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:48,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:48,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-04 17:55:48,607 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-04-04 17:55:48,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-04 17:55:48,607 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-04 17:55:48,607 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:48,607 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-04 17:55:48,607 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:48,607 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:48,607 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. started... 2023-04-04 17:55:48,608 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:48,608 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. started... 2023-04-04 17:55:48,607 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. started... 2023-04-04 17:55:48,608 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9a87c8617e1aab24933a3b43a4aadb93 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:55:48,607 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:48,608 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:48,608 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0dc260f7a393c4816ece7b947e7b7c7c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:55:48,608 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6e5dc09ac5ea944eb373dc3ef78aea3c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-04 17:55:48,649 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-04 17:55:49,053 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040417c324dbbf9046d2b99fe502d0494166 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040417c324dbbf9046d2b99fe502d0494166 2023-04-04 17:55:49,062 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404f70c00168e5b4f4badfaac384ae995ba to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230404f70c00168e5b4f4badfaac384ae995ba 2023-04-04 17:55:49,063 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404b99af257b58f44df806e66a21af48a1e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230404b99af257b58f44df806e66a21af48a1e 2023-04-04 17:55:49,077 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/1f71d21d61c3412f99920babd8b5ac9b 2023-04-04 17:55:49,467 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/506359cd52ff4cfbbd5c7f3dd0878d19 2023-04-04 17:55:49,476 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/5c6c6774c2e4404e8739f320d73bef65 2023-04-04 17:55:49,502 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304046d0f8ad766e64a309b324d97f985aa13 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202304046d0f8ad766e64a309b324d97f985aa13 2023-04-04 17:55:49,510 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/e2ff781912b44cbe9bc5a101a7c8a2bd 2023-04-04 17:55:49,512 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/1f71d21d61c3412f99920babd8b5ac9b as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/1f71d21d61c3412f99920babd8b5ac9b 2023-04-04 17:55:49,531 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/1f71d21d61c3412f99920babd8b5ac9b, entries=4, sequenceid=17, filesize=5.5 K 2023-04-04 17:55:49,531 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/e2ff781912b44cbe9bc5a101a7c8a2bd as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/e2ff781912b44cbe9bc5a101a7c8a2bd 2023-04-04 17:55:49,534 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/e2ff781912b44cbe9bc5a101a7c8a2bd, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:55:49,535 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0dc260f7a393c4816ece7b947e7b7c7c in 927ms, sequenceid=17, compaction requested=true 2023-04-04 17:55:49,535 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:49,535 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:49,535 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:49,908 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230404ccefb47c7fac491a89ecc21aed5ee1d1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230404ccefb47c7fac491a89ecc21aed5ee1d1 2023-04-04 17:55:49,911 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404941f0fe2fd584cf2a478454950cae9d8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230404941f0fe2fd584cf2a478454950cae9d8 2023-04-04 17:55:49,917 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/f19c8c3672434fc7986c01a13a2b4cd5 2023-04-04 17:55:49,920 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/5c6c6774c2e4404e8739f320d73bef65 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/5c6c6774c2e4404e8739f320d73bef65 2023-04-04 17:55:49,942 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/5c6c6774c2e4404e8739f320d73bef65, entries=4, sequenceid=17, filesize=5.5 K 2023-04-04 17:55:49,943 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/f19c8c3672434fc7986c01a13a2b4cd5 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f19c8c3672434fc7986c01a13a2b4cd5 2023-04-04 17:55:49,948 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f19c8c3672434fc7986c01a13a2b4cd5, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:55:49,948 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6e5dc09ac5ea944eb373dc3ef78aea3c in 1340ms, sequenceid=17, compaction requested=true 2023-04-04 17:55:49,949 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:49,949 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:49,949 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:50,315 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/fc665f9020884bc887b52756598c1adb 2023-04-04 17:55:50,328 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/506359cd52ff4cfbbd5c7f3dd0878d19 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/506359cd52ff4cfbbd5c7f3dd0878d19 2023-04-04 17:55:50,350 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/506359cd52ff4cfbbd5c7f3dd0878d19, entries=4, sequenceid=17, filesize=5.5 K 2023-04-04 17:55:50,350 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/fc665f9020884bc887b52756598c1adb as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/fc665f9020884bc887b52756598c1adb 2023-04-04 17:55:50,354 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/fc665f9020884bc887b52756598c1adb, entries=2, sequenceid=17, filesize=5.1 K 2023-04-04 17:55:50,354 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9a87c8617e1aab24933a3b43a4aadb93 in 1746ms, sequenceid=17, compaction requested=true 2023-04-04 17:55:50,354 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:50,354 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:50,354 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:50,355 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:50,355 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,355 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-04 17:55:50,355 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-04 17:55:50,356 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,356 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:50,356 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,356 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:50,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-04 17:55:50,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ea167a[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:50,357 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-04 17:55:50,357 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,357 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,358 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-04 17:55:50,358 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,358 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:50,358 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-04 17:55:50,358 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:50,358 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,358 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-04 17:55:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:50,358 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:50,359 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-04 17:55:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:50,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-04 17:55:50,360 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-04 17:55:50,360 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:50,360 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:50,360 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-04 17:55:50,360 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:50,361 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,361 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:50,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,361 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:50,362 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,363 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:50,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:50,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-04 17:55:50,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:50,364 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:50,365 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:50,364 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,365 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:50,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:50,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:50,365 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,465 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:50,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:50,481 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:50,489 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:50,497 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:50,498 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:50,582 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(933): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-04-04 17:55:50,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-04 17:55:50,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-04 17:55:50,584 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-04 17:55:50,584 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:50,584 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-04 17:55:50,584 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-04 17:55:50,585 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,585 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:50,585 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,585 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:50,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:50,585 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:50,586 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-04 17:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:50,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-04 17:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:50,586 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-04 17:55:50,586 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-04-04 17:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-04 17:55:50,586 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-04 17:55:50,587 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-04 17:55:50,587 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-04 17:55:50,587 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:50,587 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. started... 2023-04-04 17:55:50,587 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:50,587 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. started... 2023-04-04 17:55:50,587 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0dc260f7a393c4816ece7b947e7b7c7c 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:55:50,587 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6e5dc09ac5ea944eb373dc3ef78aea3c 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:55:50,589 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-04 17:55:50,589 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:50,589 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-04 17:55:50,589 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. started... 2023-04-04 17:55:50,589 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9a87c8617e1aab24933a3b43a4aadb93 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-04 17:55:51,426 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/1d26042bb2be4fd886cc631539ce7ec3 2023-04-04 17:55:51,426 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/ebdb1da9a0334e21b99c3a679776e7c9 2023-04-04 17:55:51,426 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/26aed24e388e42a48104bd91d3b2bbd8 2023-04-04 17:55:51,450 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebdb1da9a0334e21b99c3a679776e7c9 2023-04-04 17:55:51,450 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d26042bb2be4fd886cc631539ce7ec3 2023-04-04 17:55:51,450 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26aed24e388e42a48104bd91d3b2bbd8 2023-04-04 17:55:52,270 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/87f09f7117714e168be3c179438b8325 2023-04-04 17:55:52,270 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/c24d0513cd3b4c9981c2d3913b4cabd5 2023-04-04 17:55:52,270 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/a6ce5e889a5e4ba1bef16959af751947 2023-04-04 17:55:52,274 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6ce5e889a5e4ba1bef16959af751947 2023-04-04 17:55:52,274 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87f09f7117714e168be3c179438b8325 2023-04-04 17:55:52,274 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c24d0513cd3b4c9981c2d3913b4cabd5 2023-04-04 17:55:52,274 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/ebdb1da9a0334e21b99c3a679776e7c9 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/ebdb1da9a0334e21b99c3a679776e7c9 2023-04-04 17:55:52,274 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/26aed24e388e42a48104bd91d3b2bbd8 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/26aed24e388e42a48104bd91d3b2bbd8 2023-04-04 17:55:52,274 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/1d26042bb2be4fd886cc631539ce7ec3 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/1d26042bb2be4fd886cc631539ce7ec3 2023-04-04 17:55:52,296 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d26042bb2be4fd886cc631539ce7ec3 2023-04-04 17:55:52,296 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/1d26042bb2be4fd886cc631539ce7ec3, entries=3, sequenceid=23, filesize=5.2 K 2023-04-04 17:55:52,297 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/c24d0513cd3b4c9981c2d3913b4cabd5 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/c24d0513cd3b4c9981c2d3913b4cabd5 2023-04-04 17:55:52,300 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c24d0513cd3b4c9981c2d3913b4cabd5 2023-04-04 17:55:52,300 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/c24d0513cd3b4c9981c2d3913b4cabd5, entries=1, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:52,300 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6e5dc09ac5ea944eb373dc3ef78aea3c in 1713ms, sequenceid=23, compaction requested=true 2023-04-04 17:55:52,300 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:52,300 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:52,301 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-04 17:55:52,305 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26aed24e388e42a48104bd91d3b2bbd8 2023-04-04 17:55:52,305 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/26aed24e388e42a48104bd91d3b2bbd8, entries=3, sequenceid=23, filesize=5.2 K 2023-04-04 17:55:52,306 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/87f09f7117714e168be3c179438b8325 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/87f09f7117714e168be3c179438b8325 2023-04-04 17:55:52,306 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebdb1da9a0334e21b99c3a679776e7c9 2023-04-04 17:55:52,306 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/ebdb1da9a0334e21b99c3a679776e7c9, entries=3, sequenceid=23, filesize=5.2 K 2023-04-04 17:55:52,307 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/a6ce5e889a5e4ba1bef16959af751947 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/a6ce5e889a5e4ba1bef16959af751947 2023-04-04 17:55:52,310 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87f09f7117714e168be3c179438b8325 2023-04-04 17:55:52,310 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6ce5e889a5e4ba1bef16959af751947 2023-04-04 17:55:52,310 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/87f09f7117714e168be3c179438b8325, entries=1, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:52,310 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/a6ce5e889a5e4ba1bef16959af751947, entries=1, sequenceid=23, filesize=5.0 K 2023-04-04 17:55:52,311 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9a87c8617e1aab24933a3b43a4aadb93 in 1722ms, sequenceid=23, compaction requested=true 2023-04-04 17:55:52,311 INFO [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0dc260f7a393c4816ece7b947e7b7c7c in 1724ms, sequenceid=23, compaction requested=true 2023-04-04 17:55:52,311 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:52,311 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:52,311 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:52,311 DEBUG [rs(jenkins-hbase17.apache.org,46251,1680630785259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:52,311 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-04 17:55:52,311 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-04 17:55:52,311 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-04 17:55:52,311 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,311 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-04 17:55:52,311 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-04 17:55:52,312 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,312 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:52,312 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,312 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-04 17:55:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:52,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46251,1680630785259' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-04 17:55:52,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a9c815c[Count = 0] remaining members to acquire global barrier 2023-04-04 17:55:52,314 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-04 17:55:52,314 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,314 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,314 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-04 17:55:52,314 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-04 17:55:52,314 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase17.apache.org,46251,1680630785259' in zk 2023-04-04 17:55:52,314 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,314 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-04 17:55:52,315 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-04 17:55:52,315 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,315 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:52,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:52,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:52,315 DEBUG [member: 'jenkins-hbase17.apache.org,46251,1680630785259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-04 17:55:52,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase17.apache.org,46251,1680630785259': 2023-04-04 17:55:52,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46251,1680630785259' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-04 17:55:52,317 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-04 17:55:52,317 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-04 17:55:52,317 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-04 17:55:52,317 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-04 17:55:52,317 INFO [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-04 17:55:52,318 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:52,318 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:52,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-04 17:55:52,318 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-04 17:55:52,318 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-04 17:55:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:52,319 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-04 17:55:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-04 17:55:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:52,320 DEBUG [(jenkins-hbase17.apache.org,38287,1680630784262)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-04 17:55:52,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-04 17:55:52,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-04 17:55:52,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-04 17:55:52,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-04 17:55:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-04 17:55:52,320 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-04 17:55:52,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-04 17:55:52,321 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-04 17:55:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-04 17:55:52,421 DEBUG [Listener at localhost.localdomain/45763] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-04 17:55:52,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-04 17:55:52,423 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:52,423 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 0dc260f7a393c4816ece7b947e7b7c7c/family1 is initiating major compaction (all files) 2023-04-04 17:55:52,424 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:52,424 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:52,424 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 0dc260f7a393c4816ece7b947e7b7c7c/family1 in testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:52,425 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/b166a0564e18463a9aec345aba43f836, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/c2901ecc728340fcb35b1acf99479987, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/e44af163207148f0bd2e63c5243c8170, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/1f71d21d61c3412f99920babd8b5ac9b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/ebdb1da9a0334e21b99c3a679776e7c9] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp, totalSize=27.1 K 2023-04-04 17:55:52,426 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting b166a0564e18463a9aec345aba43f836, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630944064 2023-04-04 17:55:52,427 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting c2901ecc728340fcb35b1acf99479987, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630945171 2023-04-04 17:55:52,429 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting e44af163207148f0bd2e63c5243c8170, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630947072 2023-04-04 17:55:52,430 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 1f71d21d61c3412f99920babd8b5ac9b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630948592 2023-04-04 17:55:52,431 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting ebdb1da9a0334e21b99c3a679776e7c9, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:52,443 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 0dc260f7a393c4816ece7b947e7b7c7c#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:52,889 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023040412a9178b302f4cbfa85d428edcc0f7c2_del 2023-04-04 17:55:52,889 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040412a9178b302f4cbfa85d428edcc0f7c2_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040412a9178b302f4cbfa85d428edcc0f7c2_del 2023-04-04 17:55:53,754 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8158a770dec46bb92d7bf9c1d14c5c1 2023-04-04 17:55:53,755 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family1/e8158a770dec46bb92d7bf9c1d14c5c1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/e8158a770dec46bb92d7bf9c1d14c5c1 2023-04-04 17:55:53,774 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8158a770dec46bb92d7bf9c1d14c5c1 2023-04-04 17:55:53,775 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0dc260f7a393c4816ece7b947e7b7c7c/family1 of 0dc260f7a393c4816ece7b947e7b7c7c into e8158a770dec46bb92d7bf9c1d14c5c1(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:53,775 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:53,775 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:53,775 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 0dc260f7a393c4816ece7b947e7b7c7c/family2 is initiating major compaction (all files) 2023-04-04 17:55:53,775 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:53,775 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:53,775 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 0dc260f7a393c4816ece7b947e7b7c7c/family2 in testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:55:53,775 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/1d2a98d1ee414dc19d5c65c096ef94fa, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/bc85dcf76d5e4c87aadfcb64789750cc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/df413dc55d7a458f865aced3b2db881e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/e2ff781912b44cbe9bc5a101a7c8a2bd, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/a6ce5e889a5e4ba1bef16959af751947] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp, totalSize=25.4 K 2023-04-04 17:55:53,776 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 1d2a98d1ee414dc19d5c65c096ef94fa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630944064 2023-04-04 17:55:53,776 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting bc85dcf76d5e4c87aadfcb64789750cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630945171 2023-04-04 17:55:53,776 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting df413dc55d7a458f865aced3b2db881e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630947072 2023-04-04 17:55:53,777 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting e2ff781912b44cbe9bc5a101a7c8a2bd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630948592 2023-04-04 17:55:53,777 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting a6ce5e889a5e4ba1bef16959af751947, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:53,784 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 0dc260f7a393c4816ece7b947e7b7c7c#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:53,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/b166a0564e18463a9aec345aba43f836, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/c2901ecc728340fcb35b1acf99479987, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/e44af163207148f0bd2e63c5243c8170, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/1f71d21d61c3412f99920babd8b5ac9b, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/ebdb1da9a0334e21b99c3a679776e7c9] to archive 2023-04-04 17:55:53,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:53,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/b166a0564e18463a9aec345aba43f836 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/b166a0564e18463a9aec345aba43f836 2023-04-04 17:55:53,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/c2901ecc728340fcb35b1acf99479987 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/c2901ecc728340fcb35b1acf99479987 2023-04-04 17:55:53,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/e44af163207148f0bd2e63c5243c8170 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/e44af163207148f0bd2e63c5243c8170 2023-04-04 17:55:53,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/1f71d21d61c3412f99920babd8b5ac9b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/1f71d21d61c3412f99920babd8b5ac9b 2023-04-04 17:55:53,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/ebdb1da9a0334e21b99c3a679776e7c9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/ebdb1da9a0334e21b99c3a679776e7c9 2023-04-04 17:55:54,198 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230404abed5d4917ec4c81889f19abcbe1d867_del 2023-04-04 17:55:54,198 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230404abed5d4917ec4c81889f19abcbe1d867_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230404abed5d4917ec4c81889f19abcbe1d867_del 2023-04-04 17:55:54,617 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec4f21e2feae40e3a0dd27ff7685ad68 2023-04-04 17:55:54,618 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/.tmp/family2/ec4f21e2feae40e3a0dd27ff7685ad68 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/ec4f21e2feae40e3a0dd27ff7685ad68 2023-04-04 17:55:54,625 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec4f21e2feae40e3a0dd27ff7685ad68 2023-04-04 17:55:54,626 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0dc260f7a393c4816ece7b947e7b7c7c/family2 of 0dc260f7a393c4816ece7b947e7b7c7c into ec4f21e2feae40e3a0dd27ff7685ad68(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:54,626 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:55:54,626 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:54,626 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 6e5dc09ac5ea944eb373dc3ef78aea3c/family1 is initiating major compaction (all files) 2023-04-04 17:55:54,627 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:54,627 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:54,627 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 6e5dc09ac5ea944eb373dc3ef78aea3c/family1 in testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:54,627 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/396be4e2e1d1438397cbca714879a1a9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/121d656054514d60b75f6b043d7fa736, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/ceb33668f14140b0a6d81a7465dc1600, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/5c6c6774c2e4404e8739f320d73bef65, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/1d26042bb2be4fd886cc631539ce7ec3] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp, totalSize=27.1 K 2023-04-04 17:55:54,628 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 396be4e2e1d1438397cbca714879a1a9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630944063 2023-04-04 17:55:54,628 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 121d656054514d60b75f6b043d7fa736, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630945171 2023-04-04 17:55:54,629 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting ceb33668f14140b0a6d81a7465dc1600, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630947072 2023-04-04 17:55:54,629 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 5c6c6774c2e4404e8739f320d73bef65, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630948592 2023-04-04 17:55:54,630 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 1d26042bb2be4fd886cc631539ce7ec3, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:54,640 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 6e5dc09ac5ea944eb373dc3ef78aea3c#family1#compaction#200 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:54,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/1d2a98d1ee414dc19d5c65c096ef94fa, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/bc85dcf76d5e4c87aadfcb64789750cc, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/df413dc55d7a458f865aced3b2db881e, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/e2ff781912b44cbe9bc5a101a7c8a2bd, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/a6ce5e889a5e4ba1bef16959af751947] to archive 2023-04-04 17:55:54,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:54,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/1d2a98d1ee414dc19d5c65c096ef94fa to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/1d2a98d1ee414dc19d5c65c096ef94fa 2023-04-04 17:55:54,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/bc85dcf76d5e4c87aadfcb64789750cc to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/bc85dcf76d5e4c87aadfcb64789750cc 2023-04-04 17:55:54,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/df413dc55d7a458f865aced3b2db881e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/df413dc55d7a458f865aced3b2db881e 2023-04-04 17:55:54,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/e2ff781912b44cbe9bc5a101a7c8a2bd to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/e2ff781912b44cbe9bc5a101a7c8a2bd 2023-04-04 17:55:54,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/a6ce5e889a5e4ba1bef16959af751947 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family2/a6ce5e889a5e4ba1bef16959af751947 2023-04-04 17:55:55,077 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023040480c40a5fd7d04bbdb171a19aa718ac42_del 2023-04-04 17:55:55,078 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040480c40a5fd7d04bbdb171a19aa718ac42_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023040480c40a5fd7d04bbdb171a19aa718ac42_del 2023-04-04 17:55:55,937 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c75a5046a76e44b493a14084332efe82 2023-04-04 17:55:55,938 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family1/c75a5046a76e44b493a14084332efe82 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/c75a5046a76e44b493a14084332efe82 2023-04-04 17:55:55,965 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c75a5046a76e44b493a14084332efe82 2023-04-04 17:55:55,966 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6e5dc09ac5ea944eb373dc3ef78aea3c/family1 of 6e5dc09ac5ea944eb373dc3ef78aea3c into c75a5046a76e44b493a14084332efe82(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-04 17:55:55,966 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:55,966 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:55,966 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 6e5dc09ac5ea944eb373dc3ef78aea3c/family2 is initiating major compaction (all files) 2023-04-04 17:55:55,966 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:55,966 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:55,966 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 6e5dc09ac5ea944eb373dc3ef78aea3c/family2 in testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:55:55,966 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/a32e82aeb8514b0a8f217cb1cf6155e1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/0685f3ff62744d38b4922c1025608d2a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f38e142400474d39ae65ed3bea5cc671, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f19c8c3672434fc7986c01a13a2b4cd5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/c24d0513cd3b4c9981c2d3913b4cabd5] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp, totalSize=25.4 K 2023-04-04 17:55:55,967 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting a32e82aeb8514b0a8f217cb1cf6155e1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630944063 2023-04-04 17:55:55,967 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 0685f3ff62744d38b4922c1025608d2a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630945171 2023-04-04 17:55:55,968 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting f38e142400474d39ae65ed3bea5cc671, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630947072 2023-04-04 17:55:55,968 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting f19c8c3672434fc7986c01a13a2b4cd5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630948592 2023-04-04 17:55:55,968 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting c24d0513cd3b4c9981c2d3913b4cabd5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:55,974 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 6e5dc09ac5ea944eb373dc3ef78aea3c#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:56,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/396be4e2e1d1438397cbca714879a1a9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/121d656054514d60b75f6b043d7fa736, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/ceb33668f14140b0a6d81a7465dc1600, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/5c6c6774c2e4404e8739f320d73bef65, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/1d26042bb2be4fd886cc631539ce7ec3] to archive 2023-04-04 17:55:56,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:56,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/396be4e2e1d1438397cbca714879a1a9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/396be4e2e1d1438397cbca714879a1a9 2023-04-04 17:55:56,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/121d656054514d60b75f6b043d7fa736 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/121d656054514d60b75f6b043d7fa736 2023-04-04 17:55:56,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/ceb33668f14140b0a6d81a7465dc1600 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/ceb33668f14140b0a6d81a7465dc1600 2023-04-04 17:55:56,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/5c6c6774c2e4404e8739f320d73bef65 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/5c6c6774c2e4404e8739f320d73bef65 2023-04-04 17:55:56,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/1d26042bb2be4fd886cc631539ce7ec3 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/1d26042bb2be4fd886cc631539ce7ec3 2023-04-04 17:55:56,385 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230404cc243b20ae72496f80c08e1557a7a86c_del 2023-04-04 17:55:56,386 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404cc243b20ae72496f80c08e1557a7a86c_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230404cc243b20ae72496f80c08e1557a7a86c_del 2023-04-04 17:55:56,797 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e8a93a9a8c94f2ebde3d00c313e5fe4 2023-04-04 17:55:56,800 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/.tmp/family2/9e8a93a9a8c94f2ebde3d00c313e5fe4 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/9e8a93a9a8c94f2ebde3d00c313e5fe4 2023-04-04 17:55:56,803 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e8a93a9a8c94f2ebde3d00c313e5fe4 2023-04-04 17:55:56,804 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6e5dc09ac5ea944eb373dc3ef78aea3c/family2 of 6e5dc09ac5ea944eb373dc3ef78aea3c into 9e8a93a9a8c94f2ebde3d00c313e5fe4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:56,804 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:56,804 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:56,804 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 9a87c8617e1aab24933a3b43a4aadb93/family1 is initiating major compaction (all files) 2023-04-04 17:55:56,805 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:56,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/a32e82aeb8514b0a8f217cb1cf6155e1, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/0685f3ff62744d38b4922c1025608d2a, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f38e142400474d39ae65ed3bea5cc671, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f19c8c3672434fc7986c01a13a2b4cd5, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/c24d0513cd3b4c9981c2d3913b4cabd5] to archive 2023-04-04 17:55:56,805 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:56,806 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 9a87c8617e1aab24933a3b43a4aadb93/family1 in testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:56,806 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/15defb89b2ec452ba3bddedb51cf034f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/de7465ad4e8e4366b6061e43101db0f8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/439b28331aab4036b2395c1e09f847a2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/506359cd52ff4cfbbd5c7f3dd0878d19, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/26aed24e388e42a48104bd91d3b2bbd8] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp, totalSize=27.1 K 2023-04-04 17:55:56,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:56,807 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 15defb89b2ec452ba3bddedb51cf034f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630944064 2023-04-04 17:55:56,807 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting de7465ad4e8e4366b6061e43101db0f8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630945171 2023-04-04 17:55:56,807 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 439b28331aab4036b2395c1e09f847a2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630947072 2023-04-04 17:55:56,808 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 506359cd52ff4cfbbd5c7f3dd0878d19, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630948592 2023-04-04 17:55:56,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/a32e82aeb8514b0a8f217cb1cf6155e1 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/a32e82aeb8514b0a8f217cb1cf6155e1 2023-04-04 17:55:56,808 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 26aed24e388e42a48104bd91d3b2bbd8, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:56,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/0685f3ff62744d38b4922c1025608d2a to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/0685f3ff62744d38b4922c1025608d2a 2023-04-04 17:55:56,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f38e142400474d39ae65ed3bea5cc671 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f38e142400474d39ae65ed3bea5cc671 2023-04-04 17:55:56,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f19c8c3672434fc7986c01a13a2b4cd5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/f19c8c3672434fc7986c01a13a2b4cd5 2023-04-04 17:55:56,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/c24d0513cd3b4c9981c2d3913b4cabd5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family2/c24d0513cd3b4c9981c2d3913b4cabd5 2023-04-04 17:55:56,822 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 9a87c8617e1aab24933a3b43a4aadb93#family1#compaction#202 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:57,269 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202304042856a48b37e143ac9d8c04d119a79da5_del 2023-04-04 17:55:57,269 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304042856a48b37e143ac9d8c04d119a79da5_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304042856a48b37e143ac9d8c04d119a79da5_del 2023-04-04 17:55:57,340 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc6b2a766747462d9d13102492f4e30d 2023-04-04 17:55:57,341 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family1/dc6b2a766747462d9d13102492f4e30d as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/dc6b2a766747462d9d13102492f4e30d 2023-04-04 17:55:57,375 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc6b2a766747462d9d13102492f4e30d 2023-04-04 17:55:57,376 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9a87c8617e1aab24933a3b43a4aadb93/family1 of 9a87c8617e1aab24933a3b43a4aadb93 into dc6b2a766747462d9d13102492f4e30d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:57,376 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:57,376 DEBUG [Listener at localhost.localdomain/45763] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-04 17:55:57,376 DEBUG [Listener at localhost.localdomain/45763] regionserver.HStore(1912): 9a87c8617e1aab24933a3b43a4aadb93/family2 is initiating major compaction (all files) 2023-04-04 17:55:57,376 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-04 17:55:57,376 INFO [Listener at localhost.localdomain/45763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-04 17:55:57,377 INFO [Listener at localhost.localdomain/45763] regionserver.HRegion(2259): Starting compaction of 9a87c8617e1aab24933a3b43a4aadb93/family2 in testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:55:57,377 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/d4bbd8577e274c5198cff0ec9f01d516, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/9442872a6a3d447e9d3d3dd732d7acd9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/585e6b9111b04f34a803eafdf7756291, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/fc665f9020884bc887b52756598c1adb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/87f09f7117714e168be3c179438b8325] into tmpdir=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp, totalSize=25.4 K 2023-04-04 17:55:57,377 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting d4bbd8577e274c5198cff0ec9f01d516, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680630944064 2023-04-04 17:55:57,377 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 9442872a6a3d447e9d3d3dd732d7acd9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680630945171 2023-04-04 17:55:57,378 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 585e6b9111b04f34a803eafdf7756291, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680630947072 2023-04-04 17:55:57,378 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting fc665f9020884bc887b52756598c1adb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680630948592 2023-04-04 17:55:57,378 DEBUG [Listener at localhost.localdomain/45763] compactions.Compactor(207): Compacting 87f09f7117714e168be3c179438b8325, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-04 17:55:57,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/15defb89b2ec452ba3bddedb51cf034f, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/de7465ad4e8e4366b6061e43101db0f8, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/439b28331aab4036b2395c1e09f847a2, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/506359cd52ff4cfbbd5c7f3dd0878d19, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/26aed24e388e42a48104bd91d3b2bbd8] to archive 2023-04-04 17:55:57,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:57,407 INFO [Listener at localhost.localdomain/45763] throttle.PressureAwareThroughputController(145): 9a87c8617e1aab24933a3b43a4aadb93#family2#compaction#203 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-04 17:55:57,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/15defb89b2ec452ba3bddedb51cf034f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/15defb89b2ec452ba3bddedb51cf034f 2023-04-04 17:55:57,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/de7465ad4e8e4366b6061e43101db0f8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/de7465ad4e8e4366b6061e43101db0f8 2023-04-04 17:55:57,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/439b28331aab4036b2395c1e09f847a2 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/439b28331aab4036b2395c1e09f847a2 2023-04-04 17:55:57,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/506359cd52ff4cfbbd5c7f3dd0878d19 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/506359cd52ff4cfbbd5c7f3dd0878d19 2023-04-04 17:55:57,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/26aed24e388e42a48104bd91d3b2bbd8 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/26aed24e388e42a48104bd91d3b2bbd8 2023-04-04 17:55:57,832 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023040416de0c52036748de88ec5057262d846d_del 2023-04-04 17:55:57,832 INFO [Listener at localhost.localdomain/45763] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040416de0c52036748de88ec5057262d846d_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023040416de0c52036748de88ec5057262d846d_del 2023-04-04 17:55:58,251 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 873889e8bef2497e97584f80d46875c3 2023-04-04 17:55:58,252 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/.tmp/family2/873889e8bef2497e97584f80d46875c3 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/873889e8bef2497e97584f80d46875c3 2023-04-04 17:55:58,255 INFO [Listener at localhost.localdomain/45763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 873889e8bef2497e97584f80d46875c3 2023-04-04 17:55:58,255 INFO [Listener at localhost.localdomain/45763] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9a87c8617e1aab24933a3b43a4aadb93/family2 of 9a87c8617e1aab24933a3b43a4aadb93 into 873889e8bef2497e97584f80d46875c3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-04 17:55:58,255 DEBUG [Listener at localhost.localdomain/45763] regionserver.HRegion(2289): Compaction status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:55:58,258 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:58,261 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:58,265 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:55:58,266 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:55:58,271 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38287] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10_\xFF\x07\x000\x05\xEB\x09\x80\x19\xF1\x85\xFB\x8C\xAE\xCC"\x10\x9A\x09g3D0\x17\xEB:\xD7\x80\xD41\xCE\x88F*\x10\xA3\xB5\x15\xC7+\x06\x93\x0Fu#x\xB9~\xEA\x10#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-04-04 17:55:58,287 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-04-04 17:55:58,288 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-04-04 17:55:58,289 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:55:58,289 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680631558289 2023-04-04 17:55:58,289 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-04 17:55:58,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/d4bbd8577e274c5198cff0ec9f01d516, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/9442872a6a3d447e9d3d3dd732d7acd9, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/585e6b9111b04f34a803eafdf7756291, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/fc665f9020884bc887b52756598c1adb, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/87f09f7117714e168be3c179438b8325] to archive 2023-04-04 17:55:58,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:58,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/d4bbd8577e274c5198cff0ec9f01d516 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/d4bbd8577e274c5198cff0ec9f01d516 2023-04-04 17:55:58,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/9442872a6a3d447e9d3d3dd732d7acd9 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/9442872a6a3d447e9d3d3dd732d7acd9 2023-04-04 17:55:58,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/585e6b9111b04f34a803eafdf7756291 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/585e6b9111b04f34a803eafdf7756291 2023-04-04 17:55:58,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/fc665f9020884bc887b52756598c1adb to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/fc665f9020884bc887b52756598c1adb 2023-04-04 17:55:58,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/87f09f7117714e168be3c179438b8325 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family2/87f09f7117714e168be3c179438b8325 2023-04-04 17:55:58,564 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-04-04 17:55:58,593 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023040480c40a5fd7d04bbdb171a19aa718ac42_del 2023-04-04 17:55:58,621 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023040412a9178b302f4cbfa85d428edcc0f7c2_del 2023-04-04 17:55:58,644 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202304042856a48b37e143ac9d8c04d119a79da5_del 2023-04-04 17:55:58,644 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:55:58,644 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] zookeeper.ReadOnlyZKClient(139): Connect 0x3a7fd98a to 127.0.0.1:61441 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-04 17:55:58,648 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e952268, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-04 17:55:58,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230404 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-04 17:55:58,774 DEBUG [regionserver/jenkins-hbase17:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-04-04 17:55:59,261 DEBUG [regionserver/jenkins-hbase17:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-04-04 17:55:59,612 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230404523bccceaa55422e8f675a358239c6ee to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230404523bccceaa55422e8f675a358239c6ee 2023-04-04 17:55:59,613 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:55:59,622 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-04 17:55:59,624 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-04 17:55:59,630 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-04 17:55:59,632 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-04 17:55:59,657 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-04-04 17:55:59,657 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f}] 2023-04-04 17:55:59,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f for inclusion in 6e5dc09ac5ea944eb373dc3ef78aea3c/family1 2023-04-04 17:55:59,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-04-04 17:55:59,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first= last=1 2023-04-04 17:55:59,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:55:59,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230404/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__bm5a6ejlmb2qskekelbjo279amv85656m4m9tsd75lm704ra2ae1qj52kkqn963q/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f 2023-04-04 17:55:59,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__bm5a6ejlmb2qskekelbjo279amv85656m4m9tsd75lm704ra2ae1qj52kkqn963q/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/032dbc69cc3d42bea6688ced6083bbf2_SeqId_28_ 2023-04-04 17:55:59,692 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__bm5a6ejlmb2qskekelbjo279amv85656m4m9tsd75lm704ra2ae1qj52kkqn963q/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f into 6e5dc09ac5ea944eb373dc3ef78aea3c/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/032dbc69cc3d42bea6688ced6083bbf2_SeqId_28_ - updating store file list. 2023-04-04 17:55:59,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/032dbc69cc3d42bea6688ced6083bbf2_SeqId_28_ into 6e5dc09ac5ea944eb373dc3ef78aea3c/family1 2023-04-04 17:55:59,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__bm5a6ejlmb2qskekelbjo279amv85656m4m9tsd75lm704ra2ae1qj52kkqn963q/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f into 6e5dc09ac5ea944eb373dc3ef78aea3c/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/family1/032dbc69cc3d42bea6688ced6083bbf2_SeqId_28_) 2023-04-04 17:55:59,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__bm5a6ejlmb2qskekelbjo279amv85656m4m9tsd75lm704ra2ae1qj52kkqn963q/family1/1b3db57d45d24b8fb2e1906a1f6a0c8f 2023-04-04 17:55:59,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230404 table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:55:59,713 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:55:59,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304046bb43c12beb149b594bc615b0c9bc87f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304046bb43c12beb149b594bc615b0c9bc87f 2023-04-04 17:55:59,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304046ddcb666855540a0bdd204789213e991 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304046ddcb666855540a0bdd204789213e991 2023-04-04 17:55:59,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304047df420f008084438847c87d99fae7c6f to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202304047df420f008084438847c87d99fae7c6f 2023-04-04 17:55:59,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230404f70c00168e5b4f4badfaac384ae995ba to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230404f70c00168e5b4f4badfaac384ae995ba 2023-04-04 17:55:59,718 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-04-04 17:55:59,718 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230404' 2023-04-04 17:55:59,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230404 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-04 17:55:59,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230404 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-04 17:56:00,574 DEBUG [regionserver/jenkins-hbase17:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-04-04 17:56:00,705 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304047ab1c06093fd43cbab43e205726be4fe to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304047ab1c06093fd43cbab43e205726be4fe 2023-04-04 17:56:00,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:56:00,747 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230404/family1/32138731d9494073aa98f3166082d131 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-04-04 17:56:00,748 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230404/family1/32138731d9494073aa98f3166082d131}] 2023-04-04 17:56:00,750 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230404/family1/32138731d9494073aa98f3166082d131 for inclusion in 9a87c8617e1aab24933a3b43a4aadb93/family1 2023-04-04 17:56:00,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-04-04 17:56:00,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-04 17:56:00,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:56:00,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230404/family1/32138731d9494073aa98f3166082d131 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__uspc09nsa01l6cvlabvc0ghrpesmpl1kev48rs2sbddtjfo49hss0sougjcttmqc/family1/32138731d9494073aa98f3166082d131 2023-04-04 17:56:00,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__uspc09nsa01l6cvlabvc0ghrpesmpl1kev48rs2sbddtjfo49hss0sougjcttmqc/family1/32138731d9494073aa98f3166082d131 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/397d60de195d47049410714a7cfeb326_SeqId_28_ 2023-04-04 17:56:00,774 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__uspc09nsa01l6cvlabvc0ghrpesmpl1kev48rs2sbddtjfo49hss0sougjcttmqc/family1/32138731d9494073aa98f3166082d131 into 9a87c8617e1aab24933a3b43a4aadb93/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/397d60de195d47049410714a7cfeb326_SeqId_28_ - updating store file list. 2023-04-04 17:56:00,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/397d60de195d47049410714a7cfeb326_SeqId_28_ into 9a87c8617e1aab24933a3b43a4aadb93/family1 2023-04-04 17:56:00,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__uspc09nsa01l6cvlabvc0ghrpesmpl1kev48rs2sbddtjfo49hss0sougjcttmqc/family1/32138731d9494073aa98f3166082d131 into 9a87c8617e1aab24933a3b43a4aadb93/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/family1/397d60de195d47049410714a7cfeb326_SeqId_28_) 2023-04-04 17:56:00,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__uspc09nsa01l6cvlabvc0ghrpesmpl1kev48rs2sbddtjfo49hss0sougjcttmqc/family1/32138731d9494073aa98f3166082d131 2023-04-04 17:56:00,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230404 table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:56:00,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:56:00,801 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304040e498031b65847e1bd80a58628b609b5 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304040e498031b65847e1bd80a58628b609b5 2023-04-04 17:56:00,802 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040417c324dbbf9046d2b99fe502d0494166 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040417c324dbbf9046d2b99fe502d0494166 2023-04-04 17:56:00,803 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304045dc271e18e4c47e09608e9008ab27305 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304045dc271e18e4c47e09608e9008ab27305 2023-04-04 17:56:00,804 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230404a31597812a684a62a69afa7ad2659561 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230404a31597812a684a62a69afa7ad2659561 2023-04-04 17:56:00,804 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-04-04 17:56:00,804 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230404' 2023-04-04 17:56:00,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230404 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-04 17:56:00,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230404 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-04 17:56:01,755 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304047c06d151aef7466bba85f46494a36213 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202304047c06d151aef7466bba85f46494a36213 2023-04-04 17:56:01,755 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:56:01,813 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230404/family1/cbd26029415a490e878e9439c00f1bb0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-04-04 17:56:01,813 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c., hostname=jenkins-hbase17.apache.org,46251,1680630785259, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230404/family1/cbd26029415a490e878e9439c00f1bb0}] 2023-04-04 17:56:01,815 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230404/family1/cbd26029415a490e878e9439c00f1bb0 for inclusion in 0dc260f7a393c4816ece7b947e7b7c7c/family1 2023-04-04 17:56:01,816 DEBUG [regionserver/jenkins-hbase17:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-04-04 17:56:01,816 DEBUG [regionserver/jenkins-hbase17:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-04-04 17:56:01,816 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-04-04 17:56:01,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-04-04 17:56:01,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-04 17:56:01,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegion(2446): Flush status journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:56:01,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230404/family1/cbd26029415a490e878e9439c00f1bb0 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__tb3ilsph572d8i28mkaev4hgd1ri3741dua499indho3b4ffh6afmv778vnals2p/family1/cbd26029415a490e878e9439c00f1bb0 2023-04-04 17:56:01,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__tb3ilsph572d8i28mkaev4hgd1ri3741dua499indho3b4ffh6afmv778vnals2p/family1/cbd26029415a490e878e9439c00f1bb0 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/4a861a9483ae46e3bef0d5c300a67500_SeqId_28_ 2023-04-04 17:56:01,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__tb3ilsph572d8i28mkaev4hgd1ri3741dua499indho3b4ffh6afmv778vnals2p/family1/cbd26029415a490e878e9439c00f1bb0 into 0dc260f7a393c4816ece7b947e7b7c7c/family1 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/4a861a9483ae46e3bef0d5c300a67500_SeqId_28_ - updating store file list. 2023-04-04 17:56:01,854 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/4a861a9483ae46e3bef0d5c300a67500_SeqId_28_ into 0dc260f7a393c4816ece7b947e7b7c7c/family1 2023-04-04 17:56:01,855 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__tb3ilsph572d8i28mkaev4hgd1ri3741dua499indho3b4ffh6afmv778vnals2p/family1/cbd26029415a490e878e9439c00f1bb0 into 0dc260f7a393c4816ece7b947e7b7c7c/family1 (new location: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/family1/4a861a9483ae46e3bef0d5c300a67500_SeqId_28_) 2023-04-04 17:56:01,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46251] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/staging/jenkins__testMajorCompactionFromAdmin__tb3ilsph572d8i28mkaev4hgd1ri3741dua499indho3b4ffh6afmv778vnals2p/family1/cbd26029415a490e878e9439c00f1bb0 2023-04-04 17:56:01,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230404 table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:56:01,857 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:56:01,858 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040438448891c3ef4a17b208ddc46b9b2d5b to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040438448891c3ef4a17b208ddc46b9b2d5b 2023-04-04 17:56:01,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040440ca20950ebc48ba88062ba97cf068f4 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040440ca20950ebc48ba88062ba97cf068f4 2023-04-04 17:56:01,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230404b99af257b58f44df806e66a21af48a1e to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230404b99af257b58f44df806e66a21af48a1e 2023-04-04 17:56:01,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230404cc35d9139e4c4127ade10fdb30d71302 to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230404cc35d9139e4c4127ade10fdb30d71302 2023-04-04 17:56:01,860 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-04-04 17:56:01,860 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230404' 2023-04-04 17:56:01,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230404 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-04 17:56:01,861 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-04-04 17:56:01,861 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-04 17:56:01,861 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023040480c40a5fd7d04bbdb171a19aa718ac42_del] 2023-04-04 17:56:01,861 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:56:01,862 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023040480c40a5fd7d04bbdb171a19aa718ac42_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023040480c40a5fd7d04bbdb171a19aa718ac42_del 2023-04-04 17:56:01,862 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-04-04 17:56:01,862 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040412a9178b302f4cbfa85d428edcc0f7c2_del] 2023-04-04 17:56:01,862 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:56:01,863 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040412a9178b302f4cbfa85d428edcc0f7c2_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040412a9178b302f4cbfa85d428edcc0f7c2_del 2023-04-04 17:56:01,863 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-04-04 17:56:01,863 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304042856a48b37e143ac9d8c04d119a79da5_del] 2023-04-04 17:56:01,864 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] backup.HFileArchiver(360): Archiving compacted files. 2023-04-04 17:56:01,864 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304042856a48b37e143ac9d8c04d119a79da5_del to hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304042856a48b37e143ac9d8c04d119a79da5_del 2023-04-04 17:56:01,864 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-04-04 17:56:01,865 INFO [master/jenkins-hbase17:0:becomeActiveMaster-MasterMobCompaction-1680630789419] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-04 17:56:01,866 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-04-04 17:56:01,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.5790 sec 2023-04-04 17:56:01,887 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:56:01,889 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:56:01,892 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-04 17:56:01,893 DEBUG [Listener at localhost.localdomain/45763] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-04 17:56:01,897 INFO [Listener at localhost.localdomain/45763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-04 17:56:01,941 INFO [Listener at localhost.localdomain/45763] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 263), OpenFileDescriptor=627 (was 657), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=94 (was 112), ProcessCount=171 (was 173), AvailableMemoryMB=6488 (was 6680) 2023-04-04 17:56:01,942 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x716f2b59 to 127.0.0.1:61441 2023-04-04 17:56:01,943 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:56:01,943 INFO [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-04-04 17:56:01,943 INFO [Listener at localhost.localdomain/45763] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-04 17:56:01,943 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a61cdd0 to 127.0.0.1:61441 2023-04-04 17:56:01,943 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:56:01,943 DEBUG [Listener at localhost.localdomain/45763] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-04-04 17:56:01,943 DEBUG [Listener at localhost.localdomain/45763] util.JVMClusterUtil(257): Found active master hash=772532503, stopped=false 2023-04-04 17:56:01,943 INFO [Listener at localhost.localdomain/45763] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:56:01,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-04-04 17:56:01,945 INFO [Listener at localhost.localdomain/45763] procedure2.ProcedureExecutor(629): Stopping 2023-04-04 17:56:01,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-04-04 17:56:01,945 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:56:01,945 DEBUG [Listener at localhost.localdomain/45763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65914e20 to 127.0.0.1:61441 2023-04-04 17:56:01,945 DEBUG [Listener at localhost.localdomain/45763] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:56:01,945 INFO [Listener at localhost.localdomain/45763] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase17.apache.org,46251,1680630785259' ***** 2023-04-04 17:56:01,946 INFO [Listener at localhost.localdomain/45763] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-04-04 17:56:01,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-04 17:56:01,946 INFO [RS:0;jenkins-hbase17:46251] regionserver.HeapMemoryManager(220): Stopping 2023-04-04 17:56:01,946 INFO [RS:0;jenkins-hbase17:46251] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-04-04 17:56:01,946 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-04-04 17:56:01,946 INFO [RS:0;jenkins-hbase17:46251] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-04-04 17:56:01,946 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for f068ce02f875f9e2eb9ce3fa1b0638be 2023-04-04 17:56:01,947 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 6ff47725e297ecc75d44b4d159db9af8 2023-04-04 17:56:01,947 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 22f8a664f9eb3d423eec415bf13577f7 2023-04-04 17:56:01,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing f068ce02f875f9e2eb9ce3fa1b0638be, disabling compactions & flushes 2023-04-04 17:56:01,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:56:01,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:56:01,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. after waiting 0 ms 2023-04-04 17:56:01,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:56:01,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing f068ce02f875f9e2eb9ce3fa1b0638be 1/1 column families, dataSize=109 B heapSize=592 B 2023-04-04 17:56:01,947 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 0dc260f7a393c4816ece7b947e7b7c7c 2023-04-04 17:56:01,947 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for c13d58559c17e839b9a2079352ce59cb 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 74a0b5f9ac541529f0620ee3e73b0156 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for fa30c35db7c8b3298d236a5ab793eaab 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 2f230c29a6626fee30f4fe9a22bda5eb 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for acf2d83bae94fd197a3d0b22ed9bf897 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 6e5dc09ac5ea944eb373dc3ef78aea3c 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 935b30f108e870c49ac470cb0ed88be7 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for a2a935adeee11188aab1d3e9831bfb11 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 1d720ad2c4dc903c0b50df1d59f3ccf5 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 9a87c8617e1aab24933a3b43a4aadb93 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for a3d3fb9dbe50c3b06556b7af58c1b61e 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for ded5805e4cf2c574f015d9078347dd47 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 97ce33ec5c1b7d56a02087d1c4da7fa4 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 1d0e62f7175836cd0cc3cd697b73c3d3 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 0db0bdf042cc13ea77afe716fe561004 2023-04-04 17:56:01,948 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1145): stopping server jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:56:01,948 DEBUG [RS:0;jenkins-hbase17:46251] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7801a339 to 127.0.0.1:61441 2023-04-04 17:56:01,948 DEBUG [RS:0;jenkins-hbase17:46251] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:56:01,949 INFO [RS:0;jenkins-hbase17:46251] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-04-04 17:56:01,950 INFO [RS:0;jenkins-hbase17:46251] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-04-04 17:56:01,950 INFO [RS:0;jenkins-hbase17:46251] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-04-04 17:56:01,950 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-04-04 17:56:01,950 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-04-04 17:56:01,951 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1505): Waiting on 0db0bdf042cc13ea77afe716fe561004, 0dc260f7a393c4816ece7b947e7b7c7c, 1588230740, 1d0e62f7175836cd0cc3cd697b73c3d3, 1d720ad2c4dc903c0b50df1d59f3ccf5, 22f8a664f9eb3d423eec415bf13577f7, 2f230c29a6626fee30f4fe9a22bda5eb, 6e5dc09ac5ea944eb373dc3ef78aea3c, 6ff47725e297ecc75d44b4d159db9af8, 74a0b5f9ac541529f0620ee3e73b0156, 935b30f108e870c49ac470cb0ed88be7, 97ce33ec5c1b7d56a02087d1c4da7fa4, 9a87c8617e1aab24933a3b43a4aadb93, a2a935adeee11188aab1d3e9831bfb11, a3d3fb9dbe50c3b06556b7af58c1b61e, acf2d83bae94fd197a3d0b22ed9bf897, c13d58559c17e839b9a2079352ce59cb, ded5805e4cf2c574f015d9078347dd47, f068ce02f875f9e2eb9ce3fa1b0638be, fa30c35db7c8b3298d236a5ab793eaab, fbcdf4e9a177d06d96f6c07ba7d9a211 2023-04-04 17:56:01,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-04-04 17:56:01,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-04-04 17:56:01,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-04-04 17:56:01,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-04-04 17:56:01,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-04-04 17:56:01,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-04-04 17:56:01,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/.tmp/info/2c65969c09d44c8b9ae613c2eabecbae 2023-04-04 17:56:01,977 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-04-04 17:56:01,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/.tmp/info/2c65969c09d44c8b9ae613c2eabecbae as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/info/2c65969c09d44c8b9ae613c2eabecbae 2023-04-04 17:56:01,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/info/2c65969c09d44c8b9ae613c2eabecbae, entries=3, sequenceid=7, filesize=4.8 K 2023-04-04 17:56:01,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for f068ce02f875f9e2eb9ce3fa1b0638be in 36ms, sequenceid=7, compaction requested=false 2023-04-04 17:56:01,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/namespace/f068ce02f875f9e2eb9ce3fa1b0638be/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-04-04 17:56:01,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:56:01,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for f068ce02f875f9e2eb9ce3fa1b0638be: 2023-04-04 17:56:01,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1680630787900.f068ce02f875f9e2eb9ce3fa1b0638be. 2023-04-04 17:56:01,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 6ff47725e297ecc75d44b4d159db9af8, disabling compactions & flushes 2023-04-04 17:56:01,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:56:01,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:56:01,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. after waiting 0 ms 2023-04-04 17:56:01,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:56:01,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/6ff47725e297ecc75d44b4d159db9af8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-04-04 17:56:01,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:56:01,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 6ff47725e297ecc75d44b4d159db9af8: 2023-04-04 17:56:01,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1680630887415.6ff47725e297ecc75d44b4d159db9af8. 2023-04-04 17:56:01,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 22f8a664f9eb3d423eec415bf13577f7, disabling compactions & flushes 2023-04-04 17:56:01,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:56:01,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:56:01,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. after waiting 0 ms 2023-04-04 17:56:01,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:56:01,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/22f8a664f9eb3d423eec415bf13577f7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-04-04 17:56:01,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:56:01,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 22f8a664f9eb3d423eec415bf13577f7: 2023-04-04 17:56:01,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1680630831914.22f8a664f9eb3d423eec415bf13577f7. 2023-04-04 17:56:01,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0dc260f7a393c4816ece7b947e7b7c7c, disabling compactions & flushes 2023-04-04 17:56:01,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:56:01,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:56:01,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. after waiting 0 ms 2023-04-04 17:56:01,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:56:02,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/0dc260f7a393c4816ece7b947e7b7c7c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-04 17:56:02,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:56:02,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0dc260f7a393c4816ece7b947e7b7c7c: 2023-04-04 17:56:02,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1680630941924.0dc260f7a393c4816ece7b947e7b7c7c. 2023-04-04 17:56:02,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c13d58559c17e839b9a2079352ce59cb, disabling compactions & flushes 2023-04-04 17:56:02,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:56:02,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:56:02,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. after waiting 0 ms 2023-04-04 17:56:02,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:56:02,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/c13d58559c17e839b9a2079352ce59cb/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-04-04 17:56:02,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:56:02,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c13d58559c17e839b9a2079352ce59cb: 2023-04-04 17:56:02,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1680630831914.c13d58559c17e839b9a2079352ce59cb. 2023-04-04 17:56:02,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 74a0b5f9ac541529f0620ee3e73b0156, disabling compactions & flushes 2023-04-04 17:56:02,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:56:02,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:56:02,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. after waiting 0 ms 2023-04-04 17:56:02,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:56:02,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/74a0b5f9ac541529f0620ee3e73b0156/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-04-04 17:56:02,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:56:02,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 74a0b5f9ac541529f0620ee3e73b0156: 2023-04-04 17:56:02,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1680630887415.74a0b5f9ac541529f0620ee3e73b0156. 2023-04-04 17:56:02,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fa30c35db7c8b3298d236a5ab793eaab, disabling compactions & flushes 2023-04-04 17:56:02,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:56:02,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:56:02,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. after waiting 0 ms 2023-04-04 17:56:02,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:56:02,016 INFO [regionserver/jenkins-hbase17:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-04-04 17:56:02,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fa30c35db7c8b3298d236a5ab793eaab/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-04-04 17:56:02,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:56:02,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fa30c35db7c8b3298d236a5ab793eaab: 2023-04-04 17:56:02,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680630850964.fa30c35db7c8b3298d236a5ab793eaab. 2023-04-04 17:56:02,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2f230c29a6626fee30f4fe9a22bda5eb, disabling compactions & flushes 2023-04-04 17:56:02,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:56:02,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:56:02,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. after waiting 0 ms 2023-04-04 17:56:02,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:56:02,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2f230c29a6626fee30f4fe9a22bda5eb/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-04-04 17:56:02,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:56:02,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2f230c29a6626fee30f4fe9a22bda5eb: 2023-04-04 17:56:02,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680630867917.2f230c29a6626fee30f4fe9a22bda5eb. 2023-04-04 17:56:02,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing acf2d83bae94fd197a3d0b22ed9bf897, disabling compactions & flushes 2023-04-04 17:56:02,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:56:02,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:56:02,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. after waiting 0 ms 2023-04-04 17:56:02,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:56:02,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithWeeklyPolicy/acf2d83bae94fd197a3d0b22ed9bf897/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-04 17:56:02,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:56:02,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for acf2d83bae94fd197a3d0b22ed9bf897: 2023-04-04 17:56:02,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1680630818952.acf2d83bae94fd197a3d0b22ed9bf897. 2023-04-04 17:56:02,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 6e5dc09ac5ea944eb373dc3ef78aea3c, disabling compactions & flushes 2023-04-04 17:56:02,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:56:02,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:56:02,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. after waiting 0 ms 2023-04-04 17:56:02,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:56:02,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/6e5dc09ac5ea944eb373dc3ef78aea3c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-04 17:56:02,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:56:02,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 6e5dc09ac5ea944eb373dc3ef78aea3c: 2023-04-04 17:56:02,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1680630941924.6e5dc09ac5ea944eb373dc3ef78aea3c. 2023-04-04 17:56:02,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 935b30f108e870c49ac470cb0ed88be7, disabling compactions & flushes 2023-04-04 17:56:02,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:56:02,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:56:02,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. after waiting 0 ms 2023-04-04 17:56:02,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:56:02,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/935b30f108e870c49ac470cb0ed88be7/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-04 17:56:02,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:56:02,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 935b30f108e870c49ac470cb0ed88be7: 2023-04-04 17:56:02,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1680630910526.935b30f108e870c49ac470cb0ed88be7. 2023-04-04 17:56:02,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a2a935adeee11188aab1d3e9831bfb11, disabling compactions & flushes 2023-04-04 17:56:02,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:56:02,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:56:02,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. after waiting 0 ms 2023-04-04 17:56:02,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:56:02,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testCompactionWithHFileLink/a2a935adeee11188aab1d3e9831bfb11/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-04-04 17:56:02,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:56:02,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a2a935adeee11188aab1d3e9831bfb11: 2023-04-04 17:56:02,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1680630887415.a2a935adeee11188aab1d3e9831bfb11. 2023-04-04 17:56:02,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1d720ad2c4dc903c0b50df1d59f3ccf5, disabling compactions & flushes 2023-04-04 17:56:02,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:56:02,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:56:02,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. after waiting 0 ms 2023-04-04 17:56:02,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:56:02,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-04 17:56:02,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1d720ad2c4dc903c0b50df1d59f3ccf5/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-04-04 17:56:02,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:56:02,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1d720ad2c4dc903c0b50df1d59f3ccf5: 2023-04-04 17:56:02,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680630789594.1d720ad2c4dc903c0b50df1d59f3ccf5. 2023-04-04 17:56:02,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fbcdf4e9a177d06d96f6c07ba7d9a211, disabling compactions & flushes 2023-04-04 17:56:02,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:56:02,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:56:02,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. after waiting 0 ms 2023-04-04 17:56:02,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:56:02,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithMonthlyPolicy/fbcdf4e9a177d06d96f6c07ba7d9a211/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-04-04 17:56:02,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:56:02,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fbcdf4e9a177d06d96f6c07ba7d9a211: 2023-04-04 17:56:02,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1680630804386.fbcdf4e9a177d06d96f6c07ba7d9a211. 2023-04-04 17:56:02,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9a87c8617e1aab24933a3b43a4aadb93, disabling compactions & flushes 2023-04-04 17:56:02,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:56:02,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:56:02,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. after waiting 0 ms 2023-04-04 17:56:02,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:56:02,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionFromAdmin/9a87c8617e1aab24933a3b43a4aadb93/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-04 17:56:02,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:56:02,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9a87c8617e1aab24933a3b43a4aadb93: 2023-04-04 17:56:02,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1680630941924.9a87c8617e1aab24933a3b43a4aadb93. 2023-04-04 17:56:02,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a3d3fb9dbe50c3b06556b7af58c1b61e, disabling compactions & flushes 2023-04-04 17:56:02,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:56:02,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:56:02,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. after waiting 0 ms 2023-04-04 17:56:02,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:56:02,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMinorCompactionWithMonthlyPolicy/a3d3fb9dbe50c3b06556b7af58c1b61e/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-04-04 17:56:02,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:56:02,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a3d3fb9dbe50c3b06556b7af58c1b61e: 2023-04-04 17:56:02,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1680630929519.a3d3fb9dbe50c3b06556b7af58c1b61e. 2023-04-04 17:56:02,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ded5805e4cf2c574f015d9078347dd47, disabling compactions & flushes 2023-04-04 17:56:02,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:56:02,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:56:02,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. after waiting 0 ms 2023-04-04 17:56:02,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:56:02,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/ded5805e4cf2c574f015d9078347dd47/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-04 17:56:02,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:56:02,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ded5805e4cf2c574f015d9078347dd47: 2023-04-04 17:56:02,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1680630910526.ded5805e4cf2c574f015d9078347dd47. 2023-04-04 17:56:02,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 97ce33ec5c1b7d56a02087d1c4da7fa4, disabling compactions & flushes 2023-04-04 17:56:02,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:56:02,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:56:02,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. after waiting 0 ms 2023-04-04 17:56:02,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:56:02,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testScannerOnBulkLoadRefHFiles/97ce33ec5c1b7d56a02087d1c4da7fa4/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-04-04 17:56:02,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:56:02,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 97ce33ec5c1b7d56a02087d1c4da7fa4: 2023-04-04 17:56:02,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1680630831914.97ce33ec5c1b7d56a02087d1c4da7fa4. 2023-04-04 17:56:02,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1d0e62f7175836cd0cc3cd697b73c3d3, disabling compactions & flushes 2023-04-04 17:56:02,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:56:02,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:56:02,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. after waiting 0 ms 2023-04-04 17:56:02,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:56:02,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/default/testMajorCompactionWithWeeklyPolicy/1d0e62f7175836cd0cc3cd697b73c3d3/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-04 17:56:02,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:56:02,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1d0e62f7175836cd0cc3cd697b73c3d3: 2023-04-04 17:56:02,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1680630836977.1d0e62f7175836cd0cc3cd697b73c3d3. 2023-04-04 17:56:02,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0db0bdf042cc13ea77afe716fe561004, disabling compactions & flushes 2023-04-04 17:56:02,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:56:02,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:56:02,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. after waiting 0 ms 2023-04-04 17:56:02,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:56:02,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/ns/testMinorCompaction/0db0bdf042cc13ea77afe716fe561004/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-04 17:56:02,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:56:02,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0db0bdf042cc13ea77afe716fe561004: 2023-04-04 17:56:02,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1680630910526.0db0bdf042cc13ea77afe716fe561004. 2023-04-04 17:56:02,151 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-04-04 17:56:02,352 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-04-04 17:56:02,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/.tmp/info/b20e2c95677049f687b5696eeb0946e3 2023-04-04 17:56:02,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b20e2c95677049f687b5696eeb0946e3 2023-04-04 17:56:02,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/.tmp/rep_barrier/b96d7e4f807740c1b016201ce486b07e 2023-04-04 17:56:02,393 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b96d7e4f807740c1b016201ce486b07e 2023-04-04 17:56:02,552 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-04-04 17:56:02,577 INFO [regionserver/jenkins-hbase17:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-04-04 17:56:02,577 INFO [regionserver/jenkins-hbase17:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-04-04 17:56:02,671 DEBUG [regionserver/jenkins-hbase17:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-04-04 17:56:02,753 DEBUG [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-04-04 17:56:02,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/.tmp/table/b15cbc4e1fa24094b77bbfc7e546ae97 2023-04-04 17:56:02,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b15cbc4e1fa24094b77bbfc7e546ae97 2023-04-04 17:56:02,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/.tmp/info/b20e2c95677049f687b5696eeb0946e3 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/info/b20e2c95677049f687b5696eeb0946e3 2023-04-04 17:56:02,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b20e2c95677049f687b5696eeb0946e3 2023-04-04 17:56:02,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/info/b20e2c95677049f687b5696eeb0946e3, entries=226, sequenceid=130, filesize=37.9 K 2023-04-04 17:56:02,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/.tmp/rep_barrier/b96d7e4f807740c1b016201ce486b07e as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/rep_barrier/b96d7e4f807740c1b016201ce486b07e 2023-04-04 17:56:02,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b96d7e4f807740c1b016201ce486b07e 2023-04-04 17:56:02,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/rep_barrier/b96d7e4f807740c1b016201ce486b07e, entries=1, sequenceid=130, filesize=5.0 K 2023-04-04 17:56:02,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/.tmp/table/b15cbc4e1fa24094b77bbfc7e546ae97 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/table/b15cbc4e1fa24094b77bbfc7e546ae97 2023-04-04 17:56:02,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b15cbc4e1fa24094b77bbfc7e546ae97 2023-04-04 17:56:02,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/table/b15cbc4e1fa24094b77bbfc7e546ae97, entries=27, sequenceid=130, filesize=6.6 K 2023-04-04 17:56:02,831 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 878ms, sequenceid=130, compaction requested=false 2023-04-04 17:56:02,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-04-04 17:56:02,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-04-04 17:56:02,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-04-04 17:56:02,847 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-04-04 17:56:02,847 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-04-04 17:56:02,953 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1171): stopping server jenkins-hbase17.apache.org,46251,1680630785259; all regions closed. 2023-04-04 17:56:02,961 DEBUG [RS:0;jenkins-hbase17:46251] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/oldWALs 2023-04-04 17:56:02,961 INFO [RS:0;jenkins-hbase17:46251] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C46251%2C1680630785259.meta:.meta(num 1680630787658) 2023-04-04 17:56:02,965 DEBUG [RS:0;jenkins-hbase17:46251] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/oldWALs 2023-04-04 17:56:02,966 INFO [RS:0;jenkins-hbase17:46251] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C46251%2C1680630785259:(num 1680630786730) 2023-04-04 17:56:02,966 DEBUG [RS:0;jenkins-hbase17:46251] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:56:02,966 INFO [RS:0;jenkins-hbase17:46251] regionserver.LeaseManager(133): Closed leases 2023-04-04 17:56:02,966 INFO [RS:0;jenkins-hbase17:46251] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-04-04 17:56:02,966 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-04-04 17:56:02,967 INFO [RS:0;jenkins-hbase17:46251] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:46251 2023-04-04 17:56:02,976 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,46251,1680630785259 2023-04-04 17:56:02,976 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-04-04 17:56:02,976 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-04-04 17:56:02,976 ERROR [Listener at localhost.localdomain/45763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d0b5b75 rejected from java.util.concurrent.ThreadPoolExecutor@5934c40c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-04 17:56:02,977 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,46251,1680630785259] 2023-04-04 17:56:02,978 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,46251,1680630785259; numProcessing=1 2023-04-04 17:56:02,978 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,46251,1680630785259 already deleted, retry=false 2023-04-04 17:56:02,978 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,46251,1680630785259 expired; onlineServers=0 2023-04-04 17:56:02,978 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase17.apache.org,38287,1680630784262' ***** 2023-04-04 17:56:02,978 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-04-04 17:56:02,979 DEBUG [M:0;jenkins-hbase17:38287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f36e32c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-04-04 17:56:02,979 INFO [M:0;jenkins-hbase17:38287] regionserver.HRegionServer(1145): stopping server jenkins-hbase17.apache.org,38287,1680630784262 2023-04-04 17:56:02,979 INFO [M:0;jenkins-hbase17:38287] regionserver.HRegionServer(1171): stopping server jenkins-hbase17.apache.org,38287,1680630784262; all regions closed. 2023-04-04 17:56:02,979 DEBUG [M:0;jenkins-hbase17:38287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-04 17:56:02,979 DEBUG [M:0;jenkins-hbase17:38287] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-04-04 17:56:02,979 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-04-04 17:56:02,979 DEBUG [M:0;jenkins-hbase17:38287] cleaner.HFileCleaner(317): Stopping file delete threads 2023-04-04 17:56:02,979 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1680630786373] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1680630786373,5,FailOnTimeoutGroup] 2023-04-04 17:56:02,979 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1680630786373] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1680630786373,5,FailOnTimeoutGroup] 2023-04-04 17:56:02,979 INFO [M:0;jenkins-hbase17:38287] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-04-04 17:56:02,979 INFO [M:0;jenkins-hbase17:38287] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-04-04 17:56:02,980 INFO [M:0;jenkins-hbase17:38287] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-04-04 17:56:02,980 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-04-04 17:56:02,980 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-04 17:56:02,980 DEBUG [M:0;jenkins-hbase17:38287] master.HMaster(1512): Stopping service threads 2023-04-04 17:56:02,980 INFO [M:0;jenkins-hbase17:38287] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-04-04 17:56:02,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-04-04 17:56:02,980 ERROR [M:0;jenkins-hbase17:38287] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-04-04 17:56:02,981 INFO [M:0;jenkins-hbase17:38287] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-04-04 17:56:02,981 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-04-04 17:56:02,981 DEBUG [M:0;jenkins-hbase17:38287] zookeeper.ZKUtil(398): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-04-04 17:56:02,981 WARN [M:0;jenkins-hbase17:38287] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-04-04 17:56:02,981 INFO [M:0;jenkins-hbase17:38287] assignment.AssignmentManager(315): Stopping assignment manager 2023-04-04 17:56:02,981 INFO [M:0;jenkins-hbase17:38287] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-04-04 17:56:02,981 DEBUG [M:0;jenkins-hbase17:38287] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-04-04 17:56:02,981 INFO [M:0;jenkins-hbase17:38287] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:56:02,981 DEBUG [M:0;jenkins-hbase17:38287] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:56:02,982 DEBUG [M:0;jenkins-hbase17:38287] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-04-04 17:56:02,982 DEBUG [M:0;jenkins-hbase17:38287] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:56:02,982 INFO [M:0;jenkins-hbase17:38287] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.03 KB heapSize=598.81 KB 2023-04-04 17:56:03,077 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-04 17:56:03,077 INFO [RS:0;jenkins-hbase17:46251] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase17.apache.org,46251,1680630785259; zookeeper connection closed. 2023-04-04 17:56:03,077 ERROR [Listener at localhost.localdomain/45763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ab7bafb rejected from java.util.concurrent.ThreadPoolExecutor@5934c40c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-04 17:56:03,078 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): regionserver:46251-0x10155834d1a0001, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-04 17:56:03,078 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18c3b41f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18c3b41f 2023-04-04 17:56:03,078 ERROR [Listener at localhost.localdomain/45763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@528b393f rejected from java.util.concurrent.ThreadPoolExecutor@5934c40c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-04 17:56:03,078 INFO [Listener at localhost.localdomain/45763] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-04-04 17:56:03,395 INFO [M:0;jenkins-hbase17:38287] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.03 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2645c7faff1b42b5a64adb5ee1724142 2023-04-04 17:56:03,400 INFO [M:0;jenkins-hbase17:38287] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2645c7faff1b42b5a64adb5ee1724142 2023-04-04 17:56:03,400 DEBUG [M:0;jenkins-hbase17:38287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2645c7faff1b42b5a64adb5ee1724142 as hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2645c7faff1b42b5a64adb5ee1724142 2023-04-04 17:56:03,405 INFO [M:0;jenkins-hbase17:38287] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2645c7faff1b42b5a64adb5ee1724142 2023-04-04 17:56:03,405 INFO [M:0;jenkins-hbase17:38287] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46459/user/jenkins/test-data/5332cfaf-cd13-330e-21cb-0502fca15e39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2645c7faff1b42b5a64adb5ee1724142, entries=123, sequenceid=1005, filesize=33.3 K 2023-04-04 17:56:03,406 INFO [M:0;jenkins-hbase17:38287] regionserver.HRegion(2948): Finished flush of dataSize ~513.03 KB/525340, heapSize ~598.80 KB/613168, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 424ms, sequenceid=1005, compaction requested=false 2023-04-04 17:56:03,407 INFO [M:0;jenkins-hbase17:38287] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-04 17:56:03,407 DEBUG [M:0;jenkins-hbase17:38287] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-04-04 17:56:03,411 INFO [M:0;jenkins-hbase17:38287] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-04-04 17:56:03,411 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-04-04 17:56:03,412 INFO [M:0;jenkins-hbase17:38287] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:38287 2023-04-04 17:56:03,413 DEBUG [M:0;jenkins-hbase17:38287] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,38287,1680630784262 already deleted, retry=false 2023-04-04 17:56:03,515 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-04 17:56:03,515 INFO [M:0;jenkins-hbase17:38287] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase17.apache.org,38287,1680630784262; zookeeper connection closed. 2023-04-04 17:56:03,515 ERROR [Listener at localhost.localdomain/45763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2eba8671 rejected from java.util.concurrent.ThreadPoolExecutor@1800a3be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-04 17:56:03,515 DEBUG [Listener at localhost.localdomain/45763-EventThread] zookeeper.ZKWatcher(600): master:38287-0x10155834d1a0000, quorum=127.0.0.1:61441, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-04 17:56:03,515 ERROR [Listener at localhost.localdomain/45763-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64f73f33 rejected from java.util.concurrent.ThreadPoolExecutor@1800a3be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-04 17:56:03,518 WARN [Listener at localhost.localdomain/45763] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-04-04 17:56:03,524 INFO [Listener at localhost.localdomain/45763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-04-04 17:56:03,632 WARN [BP-1982530218-136.243.18.41-1680630780819 heartbeating to localhost.localdomain/127.0.0.1:46459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-04-04 17:56:03,632 WARN [BP-1982530218-136.243.18.41-1680630780819 heartbeating to localhost.localdomain/127.0.0.1:46459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1982530218-136.243.18.41-1680630780819 (Datanode Uuid 1b878043-772f-439b-b310-3d01a44ebeb9) service to localhost.localdomain/127.0.0.1:46459 2023-04-04 17:56:03,635 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f/dfs/data/data1/current/BP-1982530218-136.243.18.41-1680630780819] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-04-04 17:56:03,636 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ac992e57-39c4-3be4-456e-2336554b6876/cluster_29b06402-2d38-4ce4-6938-1fe6ed67e37f/dfs/data/data2/current/BP-1982530218-136.243.18.41-1680630780819] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-04-04 17:56:03,664 INFO [Listener at localhost.localdomain/45763] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-04-04 17:56:03,793 INFO [Listener at localhost.localdomain/45763] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-04-04 17:56:03,877 INFO [Listener at localhost.localdomain/45763] hbase.HBaseTestingUtility(1293): Minicluster is down